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In the untimely death of Professor John Wallace 
Baisd, of Clark University, the Journal of Applied 
Psychology has lost one of its founders and ardent 
supporters. Exhausting his energies in applying the 
facts of psychology to the task of rehabilitating the 
crippled soldiers returned from France for treatment 
at the Walter Reed Hospital, Professor Baird's al- 
ready impaired health broke down so completely that 
the best medical skill at the Johns Hopkins Hospital 
could do no more than temporarily relieve the intense 
suffering and pain which he bore with heroic patience, 
cheerfully and without complaint to the last. He died 
on the evening of February 2nd in Baltimore and was 
buried in the town of his birth, St. Mary's, Ontario, 
Canada. 

Bom on the 21st of May, 1869, he studied at the 
Universities of Toronto, Leipzig, Wisconsin, and Cor- 
nell. At the last-mentioned institution he received 
the degree of Ph.D. in 1902 and served as assistant 
in psychology and later as Carnegie Research Assist- 
ant until 1904, when he was called to Johns Hopkins 
University as instructor. In 1906 he entered the 
teaching staff of the University of Illinois, and in 
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February, 1910, he came to Clark University to take 
charge of the psychological laboratory. He has con- 
ducted and supervised many important experimental 
investigations, especially in the field of the higher 
mental functions, such as memory and the thought- 
processes. The concrete problems involved in these 
subjects aroused in him a strong- interest in the appli- 
cations of psychology, as is shown not only in such 
studies as the legibility of printers' type and memory 
for absolute pitch, but also in his enthusiastic efforts 
in helping to launch the publication of the Journal of 
Applied Psychology. When finally the opportunity 
presented itself to make use of psychological prin- 
ciples in rehabilitating wounded soldiers and helping 
them to regain control over their crippled bodies, he 
applied himself to this task with an untiring devotion 
and self-renunciation until his own strength was ex- 
hausted. 

His deep scholarship is recognized by colleagues 
and associates in requesting his services on many im- 
portant missions and in his election to the presidency 
of the American Psychological Association. He was 
loyal to his friends and deeply devoted to his family, 
and all who came in contact with him will remember 
him as a true gentleman. 
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ARMY PERSONNEL WORK. 
With Some Implications for Education and Industry. 



By Lieutenant Colonel W. V. Bingham, Carnegie Institute of 

Technology. 

(Formerly Executive Secretary of the Committee on Classification of 

personnel in the Army) 



Every practical problem of personnel in war, industry, busi- 
ness or education presents at least three phases; first, study 
of the job, that is, determination of the duties to be performed 
and specification of the qualifications necessary to perform 
those duties ; second, inventory of the individual man to ascer- 
tain and record his qualifications; third, placement of the 
man in the job. In the Army this implies a system of personnel 
classification, a routine for making accurate requisitions, a 
procedure for locating quickly the specified personnel, and a 
machinery for effecting its assignment or transfer to the post 
where it is most needed. 

It is the contention of the writer that the most fundamental 
phase of personnel work and yet the most neglected, is the first 
mentioned; namely, analysis and precise definition of duties 
and qualifications. 

Consider that almost every company in the Signal Corps 
and the Air Service has one or more soncalled " Master Signial 
Electricians." If a number of soldiers had to be trained to 
fill these various posts within a few weeks, what sort of 
recruits would you select for training? You would be at a 
loss until you knew the duties. In an Outpost Company of 
a Field Signal Battalion, a Master Signal Electrician is 
"responsible for the installation, maintenance and operation 
of small telephone offices, and for the proper functioning of 
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electrical apparatus sui^^'as buzzer-phones and short range 
radio apparatus." Bnf%v;L*each Pigeon Company of 324 men 
there are also two'l^jfeter Signal Electricians; one is " in 
charge of the traiAlng and instruction of the men as pigeoneers 
and is responsi^V'foi' the care and condition of the pigeons." 
The other, ";a8. to'f t master, is in charge of the breedmg loft 
and the -90 ntobile lofts, and is responsible for the proper 
movement* 'qf the latter. He calculates the needs of the lofts 
both .^'"^o* pigeons and as to supplies." In the Telegraph 
Coriwiuiy you want neither a iwire chief nor a racing pigeon 
f ^c^, but a telegraph engineer to " make studies and survey 
•,in^k>es for construction of permanent telephone or telegraph 
•JKries; — ^and specify layout of telephone and telegraph offices 
and power plant for common battery telephone switchboards." 
The Supply Section of an Aero Supply Squadron requires 
as its Master Signal Electrician an airplane mechanic; other 
companies need a tinsmith, a coppersmith, an armorer, a tool- 
maker, a master painter, an instrtunent repairman, a con* 
struction foreman, a storage battery electrician, a truckmaster, 
all masquerading with the title, grade and pay of Master Signal 
Electrician. In the Fabric Workers G>mpany this particular 
soldier must be a tailor, for his duties are "to supervise 
repairs and replacements to coverings for wings, fuselage 
and tail surface (in linen covered sections.) 

Another common grade in the Army is that of " Wagoner." 
In some types of units the wagoners are the soldiers who have 
to repair tfie wagons, while in other units they are mere wagon 
drivers, and in still others they must drive automobiles. The 
" horseshoer " sometimes shoes horses, but in a motorized regi- 
ments the soldier with that title repairs the motor trucks. 
One hesitates to make any assignments of skilled personnel in 
default of some definition of duties. But when you have 
secured a statement of just what the soldier or officer has 
to do, you have taken a long stride toward judicious place- 
ment and training. Without such a definition you know 
neither whom to choose nor how to train, and gross wastage 
of precious time, money and life goes on with an extravag- 
ance approximated only by the bliSie wastefulness of college 
class rooms. 

When the mobilization of the National Army began in Sep- 
tember 1917, and the nation poured into the cantonments 
its human wealth of trained artisans, teachers, business and 
professional men, laborers, farmers and shop hands, many 
of them illiterate or non-English speaking, the newly appointed 
Personnel Officers had extremely little information to guide 
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them in making judicious assignments of such varied skill 
and talent. The preparation of .this- information has de- 
manded an exhaustive study of the entire Army organization 
to determine where ability of various kinds is required. Its 
eflFective utilization has necessitated ,the development and 
supervision of an Army personnel system to discover the 
occupational, educational and military qualifications possessed 
by the recruits and to insure their assignment to the proper 
units. I 

These tasks were assigned to the .Committee on Qassiii- 
cation of Personnel in the Army, created by Secretary Baker 
on August 5, 1917, as an instrument to increase the value of 
the Army's man-power through securing the most eflFective 
placement of each man.^ i 

For this program an initial appropriation of $25,000.00 was 
made, and as the scope of the Committee's responsibilities 
grew, additional appropriations were approved until the total 
amounted to $851,650.00. 

While it happened that the original membership of the 
Committee consisted almost wholly of psychologists, many in- 
dustrial and business specialists in employing, classifying and 
assigning men were called upon to insure the successful prose- 
cution of the work. This has included the following activities : 

1. Classification and Placement of Enlisted Men: 
Personnel oflBces have been establishd in all Army divi- 
sions, depot and training camps, coast defense stations, 
aviation fields, special training camps for StaflF Corps and 
at other Army Posts. In these offices a special card sys- 
tem furnished accessible information as to the educa- 
tional, occupational, and military qualifications of every 
man. With a minimum of clerical work this system se- 
lected 973,858 men for transfer largely into technical imits 
in the Engineers, Aviation, Ordnance and other StaflF 
Corps, and even more men for transfer within the divi- 
sions or camps. Sixteen civilian supervisors, directed by 

* The Committee was organized with Walter Dill Scott as Director, 
E. L. Thorndike as Chairman, and the writer as Executive Secretary. 
The other members were J. R. Angell, R. C. Qothicr, Raymond Dodge» 
H. L. Gardner, J. F. Shepard, E. K. Strong, Jr., L. M. Tcrman, J. B. 
Watson, and R. M. Ycrkcs. The places of five of these original mem- 
bers have since been filled by J. J. Coss, W. R. DcField, W. B. Hale, 
Winslow Russell, P. J. Reilly and J. J. Swan. A large force of able, 
devoted civilian and military associates of the Committee, in Wash- 
ington, in the camps, and overseas, has made possible the realization 
of its plans. 
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the Committee, acted in an organizing and supervisory 
capacity in the field. Approximately 450 ofiicers and 
7,000 men were engaged in this personnel work. The 
number of soldiers interviewed by trained examiners and 
classified according to their best Army usefulness was in 
all, approximately three and a half million men. 

2. The Allotment Branch or Central Clearing Office 

of the Committee in Washington received reports on 
the numbers of skilled tradesmen found in each contin- 
gent of the draft, received and consolidated requisitions 
from the Staflf Corps for specialists, and prorated these 
requisitions among the various camps according to their 
supply of necessary skilled men. On November 11, 
requisitions for roughly 600,000 men of designated quali- 
fications had been filled here. Information was available 
at any moment for the Operations Division of the General 
Staff concerning the occupational qualifications of all the 
men in the several depot brigades, Anny vocational 
schools, and similar sources of supply. 

3. Trade Specifications and Index of Occupations: 

Definitions of the many hundred different trades needed 
in our military establishment were prepared after ex- 
haustive study, and were brought together in a book, 
"Army Trade Specifications." This index is an indis- 
pensable reference for Staff Corps and camp personnel 
officers in securing the skilled personnel needed. 

4. Tables of Occupational Needs and Personnel Specifications: 

Tables were prepared showing in detail the needs for 
skilled workers in each sort of platoon, company, regi- 
ment or other unit. These tables were studied, criticised, 
and approved by Army units at the front in France, and 
later formed the basis for organizing quickly the newest 
divisions. Out of these Occupational Tables have devel- 
oped the Personnel Specifications which have now been 
completed for the enlisted personnel of four hundred dif- 
ferent kinds of organizations. 

5. Trade Tests: 

To increase the accuracy of selecting skilled workers 
among the enlisted men, a system of practical trade tests 
was devised, standardized and installed in twenty camps. 
At the time of the armistice about 130,000 men who 
claimed occupational skill had been trade tested. 
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ARMY PERSONNEL WORK 7 

6. Personnel Work for Officers: 

Qualification Cards for officers, furnishing a record of 
occupational, educational and military experience and a 
rating by superior officers, were developed and put into 
use throughout the Army. These cards are filed in Wash- 
ington, and duplicates filed in the custody of the Division 
Commanders for their own use in assigning their officers. 

7. Rating of Officers: 

A uniform system of rating officers was developed. 
This rating system was first installed in the Officers' Train- 
ing Camps as an aid in selecting candidates for commis- 
sions. Later it was used in selecting candidates for Offi- 
cers' Training Schools. Now its use is universal both in 
* America and in France as a means of securing every 
, three months, a rating on every officer as an aid in deter- 
mining promotion, demotion, discharge, and appointments 
to the Officers' Reserve Corps. 

8. Commissioned Personnel Specifications: 

Definitions of duties and qualifications of no less than 
500 different kinds of officers in the various arms and 
branches of the service have been prepared, after ascer- 
taining the answer to the question, "Just what does he 
do?" These commissioned personnel specifications are 
for use in recruiting officer material, in selecting men for 
training as officers, and making assignments. Statistical 
studies have been made of the relative significance of age, 
education, civilian earnings, intelligence and other quali- 
fications of officers in the different branches of the service. 

9. Cooperation with the Air Service: 

The methods of selecting aviators were investigated and 
checked by reference to the actual success or failure of 
the pilots. An improved system of tests for aviation 
candidates was introduced and a new program of exami- 
nation and selection installed. 

10. Cooperation with the Provost Marshal General's Office: 

Plans for securing classificatory information regarding 
all registrants were submitted to the Provost Marshd 
General and were partially embodied in the draft ques- 
tionnaire. 
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11. Development Battalions: 

The Committee cooperated closely with the General 
Staff and the Surgeon General's OflSce in preparing and 
introducing the plans for segregating, sorting, training, 
and utilizing the partially fit 

12. Cooperation with the Surgeon GeneraPs Office: 

Some assistance was given to the Psychology Section 
of the Surgeon General's Department in devising and 
^ administering the intelligence tests for enlisted men and 
officers. The psychologists in turn have tested 1,716,000 
soldiers and furnished the personnel officers with their 
intelligence ratings to assist in making assignments, bal- 
ancing units, and selecting men for special responsibilities. 

13. Cooperation tvith the Navy: 

At the time of the armistice, representatives of this 
Committee were assisting the Navy and the Marine Corps 
to prepare and install a complete personnel classification 
program to correspond with the Army system. In addi- 
tion, one member of the Committee his done valuable 
work in refining methods of selecting and training men 
for special duties in the Navy, such as the work of the 
fire-control squad, the gun-pointer, the hydrophone lis- 
tener, and the lookout 

14. The War Service Exchange: 

This branch of the Committee was established January 
18, 1918, to receive and classify applications of persons 
desiring to serve the Government and to refer them to 
the branches of the service needing them, and to cooperate 
with other agencies in locating and supplying men needed 
for special purposes by the various branches of the ser- 
vice. This organization relieved high officials of the 
War Department of the necessity of devoting valuable 
time to the interviewing of the many influential men who 
came to Washington to offer their services to the Govern- 
ment It also cared for a total of about one hundred and 
ten thousand written proflFers of service. It placed ap- 
proximately ten thousand men, including many of superior 
attainments. 

15. Personnel Work in the American Expeditionary Forces: 

Members of the Committee studied the personnel needs 
of the A. E. F., and, with the cordial approval of General 
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Pershing, established there a personnel organization simi- 
lar to that in America. The Officers' Qualification Cards 
have had their widest usefulness over-seas, in supplying 
replacements and in locating rare specialists in emer- 
gencies. 

16. British Experience: 

Detailed study was made of the working of the British 
personnel organization, which in some respects is far 
superior to ours. Special reports and exhibits obtained 
in London from the British War Office, covered their 
whole program of recruitment, classification, trade-test- 
ing, assignment and transfer ; industrial furloughs ; weekly 
consolidation and analysis of strength reports; and plans 
for demobilization. 

This in outline is a picture of the personnel work, begun 
in the National Army cantonments with the arrival of the 
first trainloads of drafted men. Neither the civilians nor the 
Army Officers who initiated this development dreamed of the 
scope it would so rapidly assume or the share it would have 
in effecting .the speedy organization pi a well balanced Army, 
trained and ready for the critical hour in France. 

The Committee on Classification of Personnel in the Army 
as such has disappeared. After fourteen months of service 
under the Adjutant General it was transferred to the General 
Staff and merged with the Central Personnel Branch, newly 
created to supervise the procurement, placement, transfer and 
promotion of officers throughout all branches of the Army. 
This means that centralized control of personnel work for 
both officers and soldiers is recognized and thoroughly estab- 
lished as an integral part of the United States Army organiza- 
tion. 

Among the legacies left to the Army by the Committee, such 
as the qualification card, the index of occupations, the trade 
specifications and the standardized trade tests, not the least 
significant is the concept of personnel specifications with all 
that that term implies regarding analysis and definition of 
duties and formulation of requirements as to the physical, 
intellectual, educational, technical and personal qualifications 
required for the performance of those duties. 

The concept of personnel specifications is quite as significant 
for industry and education as it is for war. The college stu- 
dent pursuing an electrical engineering course or a course in 
interior decoration, or the young woman who aims to be a 
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secretary or a social woiicer or a teacher of the arts and crafts, 
needs a dear definition of precisely the duties for which he 
or she is being trained. 

Let the student have before him a full and explicit descrip- 
tion of the duHes of the job he must be able to hold down 
after graduation, and of the qualifkations in the form of par- 
ticular sorts of skill, technical knowledge, general abilities 
and personal traits which he must possess jf he is going to 
make a success of that job. Let each instructor be in a posi- 
tion to speak with authority when challenged to justify every 
task he assigns as contributing directly to the development of 
one or more of these essential qualifications. 

Let the factory foreman and the employment manager crys- 
talize their formulations of the precise duties and requisite 
qualifications for every post. They will clear the way for a 
program of intelligent hiring, judicious placement, effective 
training, steady promotion and just remtmeradon. 
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SAMPLE PERSONNEL SPECIFICATIONS 

HBADQUARTERS AND SUPPLY COMPANY 

ANn-AlRCRAPT SbCTOR (ARIIY AKTILLBRT) 



Army titl 

retponaing civilian occupation, the number of men, the degree oi skill and 
the occupational tjrmbol. 

On the next line appears the suggested substitute occupation. 

Then follows the description of army duties. 



2 Sergeants Major, Junior Grade: 

1 Battalion Sergeant Major. Clerical worker, general 

SMbsHtutt: Clerk, raifroad. 
Chief derk of sector office. Under direction of Adju- 
tant, supervises the preparation and filing of reports, 
returns, correspondence, orders, and bulletins. 



SubsiiittU: Merchant. 



lJoar.38g 



1 Jour. 18s 



1 UncL 



1 Jour. lOg 



Calculates the needs of the sector in quartermaster, 
sifpial, engineer, and ordnance propierty; requisi- 
tions and usues same, including oaily allowanoe of 
food and fuel, to the batteries; keeps property ac- 
counts with supply depots and batteries. 

1 First Sergeant: Foreman with qualities of leadership 

and mechanical ability 

Agent of company commander in maintaining disci- 
pline; manages company under direction of com- 
pany commander, arranging details in execution of 
ordm and assigning men to various employments; 
required to act on own initiative in emogendea in 
absence of company officers; supervises the prep- 
aration of company reports, returns, and corre- 
spondence. 

1 Electrician Sergeant. First Glass . . Electrician, general 
SubsHtuU: Telephone troubleman, outside. 
Has charge of communications system of the sector, 
exclusive of wireless. Maintains and repairs tde- 
phone sjrstem, locating " troubles " and supervising 
the work of wiremen and repairmen. Maintains 
other electrical equipment of sector, including search- 
lights. 

1 Assistant Engineer. . .Gasoline engineman, stationary 1 Jour .25b 
SubstitttU: Auto repairman, general. 
Has charge of power-generator system, gasoline en- 
gines, and motor transportation of the sector, 
directing the repairs necessary to their proper 
maintenance. 

1 Radio Sergeant Wirdess constructor 1 Jour. 31wc 

SubsHtutii Wireless operator. 
Has charge of the wireless apparatus of the sector; 
constructing, maintaining and supervising the opera- 
tions of the radio system, and the instruction of 
radio operators in the operation, care, and repair 
of wireless instruments and equipment. 
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SAMPLE PERSONNEL SPECIFICATION 

(OPPICERS) 

Name of Corps or Arm: Coast Artillery Corps 

Subdivision or Orgamsation: Battery, Motorised Gun or Hoiritaer 

Official Designation and Rank of Officer: Battery Commander, Captain 

I. Description of Dnttes* 

Commands 4 lieutenants and 219 to 278 men. Responsible for prepara- 
tion of company reports and records; for the proper equipment of his 
command and for the messing of the personnel. Responsible for property 
of the battery; guns or howitaers, motor trucks and tractors; infantry 
equipment of each soldier and other company supplies. 

Responsible for the training and discipline of officers and men as soldiers 
and their instruction in loading and firing of guns or howitaers, machine 
guns and small arms and their proper care; in motor transportation, ob- 
servation, signalling and telephonic communication; in earthwork ooor 
struction, in gas defense, and in camouflage. 

Responsible for the tactical movement of his battery (men, guns and 
equipment); tactical preparation of position for guns; orientation (by 
means of surveying); calculation of firing data (involving use of trigonome- 
try and logarithms) and correction of data when firing and under fire. 

When battery operates independently will assume duties of Major, re> 
quiring tactical judgment in reconnaisance, and initiative in direction and 
supervision of fire. 

II. SPECIAL TECHNICAL QUALIFICATIONS. 

Required: Working knowledge of mathematics through trigonometrT 

and logarithms. 
Deslrod: Knowledge of mechanifs, electricity, and motor transportation. 

ni. FIRST CHOICE OF CIVILIAN OCCUPATION. 

Years of Experience 
Civu Knginfff 3 — 5 

IV. OTHER CHOICES OF CIVILIAN OCCUPATION. 

Years of Experience 

Electrical or mechanical enginerr 3 — 6 

Graduate of recognised technical school with 

business or professional experience 3 — ^5 

College graduate with business or professional 

experience 3 — 5 

V. STAFF CORPS SCHOOL. 

Will be required to attend school for three months. 

VI. AGE LIMITS. 

Possible Age Limit 25-45 years. 
Best Age Limit 30-40 years. 

VII. PHYSICAL REQUIREMENTS. 

Officer must be qualified for full military service. 

VIII. MINIMUM SCHOOLING. 

Two years of college. 
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A STANDARDIZED GROUP EXAMINATION OF IN- 
TELLIGENCE INDEPENDENT OF LANGUAGE 



By Edwabd L. Thorndikb, Teachers G>llege, G>lumbia University 



I. Description of the Tests 

The practicability of having one examiner measure the in- 
telligence of a large group of persons at one time has been 
fully demonstrated by four years' experience of the Metropol- 
itan Life Insurance Company with a test devised by the writer, 
by the work of McCall for the New York State Ventilation 
Commission, and lately on an extraordinarily wide scale by 
the experience of the United States Army with the admirable 
examinations devised by the Psychology Committee of the 
National Research Council. 

Such group examinations reduce expense, increase uniform- 
ity of procedure, and, if extensive enough, give a more accu- 
rate determination of intellect than would be obtained by an 
hour's interview by the average of the most competent third 
of physicians, teachers or psychologists. They cannot, of 
course, do the work of a specially talented diagnostician of 
intellect, who adapts his examination to the peculiarities of 
each case and sees the bearings of minute features of each 
response. But not over one in ten of physicians, teachers and 
psychologists would claim such special talents. They cannot 
detect malingering or suggest the causes of the degree of 
dullness found. They are therefore only accessory features 
of a general mental examination, inventory, and diagnosis. 
But where the persons examined are doing their best to score 
well, and in so far as the question is simply " How intelligent 
is this man or boy?" they are, if well devised, substantially 
adequate. And where large numbers are to be examined, 
they are a useful first step in a general mental examination, 
inventory and diagnosis. 

The first forms of group examinations of intelligence con- 
sisted chiefly of intellectual tasks with words and num- 
bers and presupposed a considerable ability to read. They 
were thus unavailable for use with foreigners and illiterates, 
were unfair to those of limited opportunity to learn to rtfad 
well, and in all cases measured intelligence with words and 

13 
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numbers to the relative exclusion of intelligence in dealing 
with things and people. 

The psychologists in the army therefore made up from the 
various non-verbal tests which had been devised and experi- 
mented with, by Norsworthy, Knox, Porteus, Dearborn, Kel- 
ley, Pintner and Patterson and others, a composite examina- 
tion, the directions for which could be given by gesture and 
the execution of which required no acquaintance with spoken 
or written English. This formed the well-known Beta ex- 
amination of the army. 

The present examination is of the same general nature as 
the Beta examination, but differs from it in the following 
points : 

Ten alternative forms of the examinations are provided in 
place of the single form, to reduce the harm from unfair 
tutoring. 

Each form is more extensive. 

In the score, speed coimts relatively much less, the candi- 
date being given time enough to exhaust his ability in most 
of the eirfit tests used. 

In the Beta examination the examiner was permitted to use 
speech, and to vary his treatment of groups somewhat. In 
the present examination all procedure is rigidly uniform. 

In the Beta examination the effort was made to secure in 
the directions the maximum of comprehension of the general 
nature of each task, the score being intended to represent the 
candidate's ability to do harder and harder elements of an 
understood task and to do them quickly. In the present ex- 
amination the effort is to make the directions identical for 
all and such as will be unvaried in their effect by the exam- 
iner's personality, zeal, dramatic ability, or experience in giv- 
ing the examinations. Each of these plans has its peculiar 
advantages. 

The content in the Beta examination was chosen primarily 
for high correlation with intellect as tested by the ordinary 
verbal forms of examination, such as the Stanford Binet or 
the Army Alpha examination. The Beta examination was 
intended for use as an alternative to Alpha. The content in 
the present examination was chosen primarily for high cor- 
relation with intellect as employed in managing both things 
and words. The examination is intended for use as a supple- 
ment to standard tests of verbal intelligence. 

The following four types of tests used in the Beta examina- 
tion are used also in the present examination : a test in substi- 
tuting arbitrary symbols for digits ; a test in drawing lines so 
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as to divide a surface into the parts shown beside it (the 
tasks are made rather harder, however) ; a test in completing 
pictures (the content here is however very different from that 
m the Healey, Pintner-Patterson, or Beta test, being made up 
largely of common material objects minus some essential part ; 
a test in completing a rhythmic series of forms (the rhythms 
here are more vari^, depend less on counting and are harder). 

To these are added an analogies test with pictures,^ a mixed 
spatial-relations test, a test of memory of objects, and a test 
in easy computation. 

The material for an examination consists of two forms of 
Series I as shown on page 15-16, one form of series II shown 
on page 19-20, and the large sample sheets for I and II to be 
done by the examiner, shown on pages 17-18, 21-22. 

The examination is given in three parts, I ; I repeat, and II, 
the procedure being as follows: The candidates stand in a 
group of from 25 to 35 facing at^ easel on which is a large 
sheet, 36' x 20^, like the Sample Sheet for Series I, Tests i and 
2, shown below. The examiner says : 

" We shall give you a sheet like this (holding up a Series I 
sheet). When you get it and are told to begin, do the work 
on it as fast as you can, but make no mistakes. If you come 
to something that you can't do, go ahead to the next thing. 
Do everything that you can. If you finish before time is 
called go back and make sure ever)rthing you did is right. 
Look at me. (If the group is large so that the two examiners 
are present, the instructions will be, * Look at me or at the 
other man'). See what I do on this big sheet. When you 
get the sheet of paper, do the same as I did."* 

He then fills the empty spaces in the five rows according 
to the pattern and draws lines cutting the squares into the 
parts shown, at a rate and in a manner prescribed for uni- 
form use.* 

He then turns the sheet over, displaying as its reverse the 
Sample Sheet for Part I, Tests 3 and 4. He writes X, V, etc., 

iThis differs radically from that tried out and discarded by the 
Division of Psychology in the army. The test here is made very 
difficult, the four pictures from which choice is to be made all being 
relevant to one or more of the three which determine the choice, and 
the three "wrong" ones especially so. A right choice is not made 
by stupid people once out of four times nor even once out of ten times. 

* These instructions may be spoken or displayed in printed form in 
any language desired. 

« Detailed instructions for giving the tests are provided. The de- 
scription here is abbreviated. Means to dispense entirely with 
language can be arranged if desired. 
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in the appropriate places, pointing to the blank spaces and to 
Uie key above after a prescribed method. In the last test of 
the four he marks the hat, cup, side-wheel steamer, and nest 
after certain instructive pointings. 

The Part I test blanks arc then distributed and 16 minutes 
are allowed for the work. At the end of 4 minutes the ex- 
aminer says, " Even if you haven't finished Test 1, begin Test 
2." At the end of 4 minutes more he says, " Even if you 
haven't finished Test 2, begin Test 3." Similarly at the end 
of 4 minutes more. Assistants see that these instructions are 
carried out by the candidates. 

A different form of the san^ Series I is then used and wiA. 
2>4 + 2J4 + 23^ + 2>4 minutes time, 10 minutes in all. 

The candidates are then brought to the front of the room, 
the examiner directs their attention to a Part II sheet, and 
to the large Sample Sheet for Series II. Specimens of these 
appear on pages 19, 20 and 21, 22. The examiner fills in the 
missing' parts, and draws the geometrical forms of Tests 1 
and 2 of the sample sheet, making certain instructive pointings 
while doing so. He then does the work of Test 3, turning the 
large sample sheet over just as a candidate will have to do with 
the regular sheet, and finally does the computing of Test 4 on 
the large sample sheet. 

The test sheets are then distributed and the men set at work. 
At the end of 4 minutes they are directd to begin on Test 2 if 
they have not already done so; at the end of 8 minutes they 
are directed to begin on Test 3 if they have not already done 
so. Similarly for Test 4 at the end of 12 minutes. At the 
eiid of 16 minutes all stop. The details for the administration 
of the examination will be reported elsewhere. One man can 
examine at one time as many individuals as can clearly see 
the large sample sheet, that is, from 30 to 40. An hour is 
required, of which 42 minutes are actual working time for the 
candidates. Any intelligent and careful person of the class 
of teachers, medical men, employment managers, social workers 
or the like can learn to give the examination adequately in 
an afternoon. 

The results are quickly scored with the aid of keys. Tests 
I 1, 1 3 and I 4, and II o and II 4 can be scored by any clerk. 
Tests I 2, II 1, and II 2 require either a moderate amount of 
judgment or a few hours of supervision by somebody of good 
judgment. 

We have in this hour's examination obviously an extremely 
convenient instrument for measuring, and presenting in a 
numerical score, an individual's degree of success in meetii^ 
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certain demands on intelligence irrespective of lan^^ge. If 
that score is significant of important facts about the individual, 
the examination is destined to be of value in schools, industry, 
business, social, philanthropic and legal work. 

II. The Significance of the Examination Score 

We shall consider first the significance of the score when 
the candidate takes it without having any previous acquaint- 
ance with it. In a later section we shall note any modifica- 
tions or limitations to the significance of the score, supposing 
that the examination is public property (like the Stanford 
Binet) so that any person may study up for it as he may for 
a college entrance, or civil service, or immigration examina- 
tion. 

The examination, used under working conditions (i. e., in 
accordance with the detailed instructions prepared, by persons 
who had spent an afternoon in studying them and it, and a 
half-day in practice in testing school classes) yielded the fol- 
lowing median scores for groups of increasing intelligence : 

5 for 133 individuals 19 years old or over confined in insti- 
tutions for idiots, imbeciles and the feeble-minded, and 
representing roughly the top tenth of their inmates in 
respect to intelligence. Less than 1 in 10 scores above 40. 

PS for 171 sixth-grade boys largely of parents from the middle 
economic and social third of a large city. 

11^ for 190 sixth-grade boys largely of parents from the upper 
economic and social third of a large city. 

1^0 for 169 fourth-year public high-school boys selected for 
continuance in school largely by ability. Only one in ten 
scores below 140. 

^10 for 104 superior adults, men commissioned or about to 
be commissioned in the United States Army. Only one 
in twenty-five scores below 140. 

The distribution of all the individual scores for these groups, 
combining all the sixth-grade cases, is as shown in Table 1. 
It should be noted that the three individuals of the asylum 
cases who scored above 80 are described as follows by the 
authorities of the institution: 

42 years old, understands most of the farm work, cares for 
horses and cows, drives team and plows, handles tools well. 
For quite a number of years has worked with engineers and 
steam fitters. Has done firing in boiler room under super- 
vision. Enjoys and has a fair working knowledge of steam- 
fitting and ordinary electrical repairs. 
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19 years old, reads and writes, does a little number work, 
has very good memory. Does wood-work well. Makes 
brooms, brushes with little supervision. Is quite deaf. Has 
worked for several years with the carpenter, doing repair 
work in the manual training department. Usually his work 
is well done. Is capable of doing high-class work both in this 
and about the farm. 

19 years old. No personal report was made, but he is re- 
corded as testing 9.9 mental age by the Binet test, and can 
read and write. 

In the case of the feeble-minded confined at one of the two 
institutions, data were available for the Binet mental age, the 
grade reached in school and the ability shown in doin^ work 
in the institution and its farm colony. Scores were gfiven to 
each of the 79 individuals in the form of the sum of credits 
obtained by counting: 

B be 

lor Binet age 6 or bdow for grade 2 or below reached 

2 " " ^* 7 3 " " 3 

4 " " •* 8 5 " " 4 

7 " " " Q A " " 5 

10 " " " 10 12 " " 6 

14 " " " 11 

20 " •• " 12 

Wo. 
1 for 6 or 7 attained as the sum of 5 estimates of the work report 
2for8or9 " 
SforlOorll " 
and 80 on, i4> to 
10for24or25 " 

Te 
0,2 X the test score. 

We have correlations (by Sheppard's formula) as follows, 
showing that the test score is as good an index of intelligence 
in these cases as the Binet : 

Binet with B +^c + Wo +Te 79 

Test " B+Sc+Wo+Te 93 

Binet " Sc + W 77 

Test " Sc+W 77 

3inet " B + Sc + Wo 91 

Test " B + Sc + Wo 84 

Onet " Sc+Wo+Te 75 

Test " Sc+Wo + Te 97 

The authorities of the institution also reported that the 
rank-order of intellect obtained by the test tallied very closely 
with the estimates which they had formed. 
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A more exact result than the above could be obtained by 
assigning weights precisely so as to g^ve the Binet and the 
Test Score absolutely equal weight in determining the com- 
posites. In the above Test Score has somewhat more weight, 
the distributions being : 

Credits Binet Test Score Credits Binet Test Score 






14 


23 


11 
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10 


12 
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24 


12 


13 
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14 
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25 
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15 
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16 




6 
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17 
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11 
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18 




8 
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19 
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9 
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20 


1 1 


10 
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21 


1 
and 1 at 30 



However, Sheppard's formula being used, the discrepancy 
will not amotmt to much ; and it does not seem worth whfle 
to expend labor in the computation. The test-score is at least 
substantially as significant as the Binet Score. 

In the case of 196 privates and non-commissioned officers 
who were ranked by a consensus of their officers and fellow 
soldiers for intelligence, the correlations were .23, .33, .43, .50, 
.53, and .58 for the six groups, with a median of .47 ±S)5. 
This correlation is almost the same as that obtained between 
the consensus measure of intelligence and the regular army 
test Alpha in the case of sixty of these men who were tested 
with Alpha. The correlation with the real intelligence pos- 
sessed by these men would presumably be higher, the amount 
of intellect imputed by the consensus being itself in each case 
an imperfect measure of the reality. 

The test-score thus compares favorably with the score from 
the standard instruments for measuring intelligence, the Binet 
and the Alpha, in respect to the prophecy of intelligence given 
by it in the case of adults of low grade and adults in general. 
It is not suitable for distinguishing amongst adults of very 
high grade. Nor, in my opinion, is the Binet or the Alpha. 

It has an advantage over the Binet, aside from its applica- 
bility to groups and to non-English speaking individuals. It 
is almost indefinitely extensible to alternate forms of equal 
difficulty so that a measure of any desired degree of reliability 
may be obtained, and measures of the effect of growth, train- 
ing, fatigue, drugs or any other factor may be conveniently 
obtained. Ten forms are already prepared. 
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It has an advantage over Alpha aside from its non-verbal 
content, in that it distributes the cases of low intellect much 
more widely. 

We have not been able to check the results against those 
from the Beta test, as yet. Presumably the two will do much 
the same work, the choice being primarily for convenience; 
though the lessening of the weight attached to speed seems to 
the writer theoretically and practically sound. 

The test then seems destined to be useful alone, or with 
other " performance " tests, in the case of immigrants, illit- 
erates, and all groups characterized by the absence of oppor- 
tunity to learn English (or any other language) or great in- 
equalities in such opportunity. It will be useful as an alterna- 
tive for, or supplement to, the Binet, Alpha and similar tests 
in the case of tiiose who can understand and use English. 

The test scores may be transmuted into Alpha scores, or 
Stanford Binet Mental Ages, or standard points on the scale 
for sixth grade pupils, by Table II,* which is derived from 
the scores of 163 individuals tested with both this test and 
Alpha, 134 individuals tested with both this test and the Binet, 
and over a thousand individuals tested with this test alone. 

These equivalents and other items entered in this table will 
give an adequate notion of the significance of any given score 
for any given person in respect to educational or vocational 
or general social promise, so far as these depend on the quali- 
ties measured by the test. 

The scores of this table and all the results so far stated are 
for a first trial with the test by a person who has never been 
coached with a view to improvmg his score in this or a similar 
test. This introduces us to one of the chief difficulties of this 
and all other present instnmients for the measurement of 
intelligence. 

Improvement is made in score quite innocently in a second 
trial though the individual has never thought of the test in 
the meantime, by reason of the general familiarity with the 
tasks, adaptation to them, and whatever other special advan- 
tages a preliminary trial gives. In the Binet this averages 
about 3 mo. of mental age; in the Alpha the median gain is 
about 15 points (unweighted system) for men of A and B 
grade; in the present test the median gain is 10 points for 
sixth-grade school boys and average adult men, and 14 points 
for superior adults. This matter can be neglected so long as 
the tests are little known and used only for diagnosis and 
surveys. As they become widely known and are used to 

^ Table II is an abstract from a more extensive and detailed table. 
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TABLE 


II. 




1 


Sauivalent 


Equivalent 
^anford 


6th 


Stanford 


Test Alpha 


erade 
Boys 


Mental Age 
Estimated 


Score 


Score 


Mental Age 






inF.M/t. 






5 Median of 133 hi|h grade. F. M't. in insUtuUona 


25 




8i 






37 






— 2.0S.D. 




. 40 


40 








45 


42 






9 yr. 6 mo. 


50 


44 








54 






— 1.5S.D. 


,111 


55 


47 






60 


49 






-^ 


65 


51 






10yr.6mo. 


70 


53 








71 






— 1.0S.D. 




75 


55 








80 


57 








85 


59 






llyr.6mo. 


87 






— 0.5S.D. 




90 


61 








95 


63 








100 Median 12 


yr. mo. old boy 




105 


67 









110 


69 








115 


70 








120 
122 
125 


72 




+0.5S.D. 




74 








130 


76 








135 


78 








139 






+ 1.0S.D. 




140 


82 








145 


86 








150 


90 








155 


93 








156 






+ 1.5S.D. 




160 


97 








165 


101 








170 Median Att 


1 year H. S. boyt 




172 


106 




+2.0S.D. 




175 


109 








180 


114 








185 


117 








190 


120 








195 


123 








200 


126 








205 


129 


Superior Adult 




210 


132 








215 


135 








220 


138 








225 


141 








230 


145 









measure progress or the effect of various factors, it must be 
allowed tor, and tables for the significance of second-trial 
scores, third-trial scores and so on must be computed. The 

S[ain of a third trial over a second may be expected to be much 
ess than that of a second over a first, roughly about .4 as 
much. 

Improvement may be made in score by tuition over what 
would have been made without it. This is obvious to com- 
mon sense. The tuition may be multiform, from general 
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coaching in taking tests to special drill in drawing a diamond 
or counting backward or denning words or learning opposites 
or understanding what is required in the analogies test or 
solving particular arithmetical problems. Experiment can de- 
termine the amount of influence of any defined amount of such 
coaching, and various measures can be taken to prevent illegiti- 
mate coaching from injuring the significance of a test score. 
Some of these are the provision of many alternative forms, 
the changing of test elements so that special coaching will 
mislead as much as it helps, the provision of a preliminary 
trial to put those who have not been coached more nearly on 
a level with those who have, so far as understanding the gen- 
eral nature of- the test goes, and the separate computation of 
scores from the more coachable and the less coachable tests 
of the series. 

In proportion as a high score in this test is used to confer 
any advantage upon an individual the procedure will have to 
be made adequate to prevent or at least detect such special 
coaching. This is even more true, however, of other standard 
examinations for intelligence, since they lack the protection of 
many alternative forms. Much such work must be done in 
the future.* 

It should be noted that for many purposes the energy and 
ambition and industry of a candidate who studies ten or a 
dozen alternative forms of a test like this, so as to score high 
with whichever one confronts him at the examination, is a 
practical equivalent of the ability which enables him to score 
equally high without study. Such might be the case in many 
examinations for employment. 

For cases where the test is to be used to measure progress 
or the effect of some factor,- the reliability of the score is a 
matter of importance. The question as to how closely the 
score from one first trial of the test will represent the average 
score from an infinite number of first trials is of course es- 
sentially imanswerable. There is, however, a means of ob- 
taining an approximate answer by the formula P. E. = yJ2 
(median variation of difference between first-trial score and 
second-trial score). 

According to this the probable error of a single determina- 
tion of the test is : 

'These matters have been more fully discussed by the writer in 
Tests of Intelligence : Reliability, Significance, Susceptibility to Special 
Training and Adaption to the General Nature of the Task, in School 
and Society, of Feb. 15, 1919. 
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14 for superior adults with a median score of 210 
8 for adults somewhat above average with a 

median score of 140 

8 for 6th grade pupils with a median score of 95 

These results are based on repeated tests of 54, 46 and 143 
individuals respectively. These figures are too high since they 
are a product of other causes of variability than the differ- 
ences m the same ability in the same individual from one day 
to another. It is therefore conservative to estimate the Prob- 
able Error of a first time score as not over 6 or 7% of the 
score, for scores from 70 up. 

The unreliability of a single second trial as a representative 
of the theoretical average of an infinite number of second 
trials, and similarly for a third or for a fourth trial, will pre- 
sumably be less than the estimates given above for a first trial. 
Certain causes of variability are removed by acquaintance 
with the general nature of the test. We may, I think, expect 
that if two trials are given as practice tests and then a third 
and fourth trial as tests of morning versus afternoon, or of 
ability at age 15 versus ability at age 16, or of alcohol versus 
no alcohol, or the like, the probable error of the second score 
will be well under 6% of the score itself .• 

• These tests may be obtained from the Bureau of Publications, 
Teachers College, Columbia University, together with the large sample 
display sheets and the standard instructions for giving and scoring the 
tests. 
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EDUCATIONAL DIFFERENCES AMONG TRADES- 
MEN 



Herbert A. Toops and Rudolph Pintner, Ohio State University. 



In no other country and at no other time has there ever been 
such emphasis laid upon the necessity for a sound education 
in order to make good in the business of life. We believe in 
education. We know that good schooling is an asset to any 
man in any walk of life. The war has brought the fact 
home to us as never before. And the people of this country 
believe in it so much that they are willing to see their govern- 
ment spend thousands of dollars in order to allow some of 
the youth of the country to continue their college training at 
the country's expense. 

That there is a relationship between the amount of educa- 
tion and the kind of position a man occupies is obviously true, 
despite individual exceptions. Between the trade and the 
profession there is a very marked difference. Does the same 
difference occur among the trades themselves? If sp, what 
do we actually find to be the educational achievement of men 
in the various trades and how do the trades rank among them- 
selves in regard to the educational attainments of the men? 

The writers have had the opportunity of personally ascer- 
taining the amount of education obtained by a great many 
tradesmen in a number of trades. The results and the con- 
clusions derived are here presented, not as an exhaustive 
survey of even a single trade, but as indicative of some general 
existing tendencies. 

The tradesmen questioned were employed in various shops 
of a large manufacturing city. They came from both large 
and small shops. In some cases practically every man of the 
trade in the city was questioned ; in other cases only a liberal 
sampling was taken. The men in all the trades here considered 
are probably representative of the general type of man in 
each trade as found in this city. 

In addition to the grade at which each man left school, 
there was determined as well the status of the man in his 
trade, whether apprentice, (A), joume)mian, (J), or expert, 
(E). In rather a general way the definition of each status 
or class was as follows: 
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Apprentice — ^A beginner or learner in the trade, determined 
by length of experience in the trade, kind of shop, and the 
foreman's estimate of the man. In no trade was more than 
five years experience necessary as an apprenticeship stage 
for ordinary individuals. 

Journeyman — A man past the apprenticeship period but not 
yet an expert. A practical criterion for a journeyman was 
that he was incapable of working without directions or in- 
capable of directing others. A man with the requisite mini- 
mum of experience for an expert but not so classed by his 
foreman, was classed as a journeyman. 

Expert — A man past a definite minimum of experience and 
classed as an expert by his foreman. A foreman of a shop 
was nearly always classed as an expert. A man capable of 
acting as a foreman or capable of working alone on difficult 
jobs without direction from others was also ordinarily classed 
as an expert. 

It can be readily seen that there is no sharp dividing line 
between these classes, which are only arbitrary and artificial 
classifications. These three classes are, however, commonly 
recognized in the trades. In many cases it was \ difficult to 
decide in which status to put a given man. In such cases all 
possible evidence was taken into account and the man classified 
according to our best judgment based on this evidence. Since 
the dividing lines between the classes are only arbitrary divi- 
sions we find not only much overlapping of trade ability, but 
also much overlapping in any trait in which the classes might 
be measured, and therefore, in their educational attainments. 

Many of the trades are similar in scope, as for instance, 
lathehand and toolmaker. Here we should expect great 
similarity in the education of the men in these trades. Other 
trades may be found which are very dissimilar, as horse- 
shoeing and electrical instrument repairing. Between such 
trades we expect striking educational diflFerences to occur. 

Reports from 924 tradesmen are here given. These are 
distributed among thirty diflFerent trades. The blacksmiths 
were machine shop blacksmiths doing hand forging. The 
telephone linemen included a small number of telegraph line- 
men doing the same kind of work. The carpenters were house 
carpenters. Bench-hand is the name given to the trade of 
bench assembler and fitter. Powerhouse (A. C. and D. C.) 
were switchboard tenders on these respective kinds of switch- 
boards. Electrical instrument repairers were ammeter and 
voltmeter repairers. General auto repair is but another name 
for general garage man. The ammonia pipefitters were re- 
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frigerating pipefitters. Storage battery men had to do with 
repairing automobile storage batteries. The switchboard 
repairers were telephone switchboard repairers at telephone 
stations. The carburetor men were general garage m^n who 



Table I. Distribution op Tradesmen, in Numbers and Per Cent, 
BY Grade At Leaving Schocx. and by Trade Status 





Numbers 


Percent. 


Grade 


Employed 


9,506 


Employed 




Total 


A 


J 


E 


Unem. 


Total 


A 


J 


E 


Column 


1 


2 


3 


4 


5 


6 


7 


8 


9 


Ncxie 


9 


2 


4 


3 


2.1 


1.0 


0.8 


1.3 


0.8 


1 


3 





2 


1 


0.8 


0.3 


0.0 


0.6 


0.3 


2 


7 


1 


4 


2 


1.3 


0.8 


0.4 


1.3 


0.6 


3 


11 


1 


7 


3 


2.7 


1.2 


0.4 


2.3 


0.8 


4 


26 


5 


13 


8 


4.8 


2.8 


2.0 


4.2 


2.2 


5 


43 


13 


16 


14 


7.3 


4.7 


5.1 


5.2 


3.9 


6 


109 


25 


52 


32 


10.2 


11.8 


9.9 


16.9 


8.8 


7 


91 


31 


23 


37 


10.6 


9.8 


12.3 


7.5 


10.2 


8 


417 


113 


142 


162 


33.8 


45.1 


44.9 


45.9 


44.6 


IH.S. 


56 


18 


15 


23 


8.8 


6.1 


7.1 


4.9 


6.3 


II H. S. 


59 


21 


10 


28 


6.6 


6.4 


8.3 


3.2 


7.7 


Ill H. S. 


25 


7 


6 


12 


3.0 


2.7 


2.8 


2.0 


3.3 


IVH.S. 


46 


11 


11 


24 


5.2 


5.0 


4.4 


3.5 


6.6 


A CoU^ 


5 






5 


0.8 


0.5 






1.4 


B CoU^ 


3 


2 




1 


0.8 


0.3 


6.8 




0.3 


C College 


4 




2 


2 


0.3 


0.4 


. . 


6.6 


0.5 


D College 
Total 


10 


2 


2 


6 


0.8 


1.1 


0.8 


0.6 


1.7 


924 


252 


309 


363 


99.9 


100.0 


100.0 


100.0 


100.0 


Part H. S. or 


better educa 


tion 


26.4 


22.5 


24.2 


14.9 


27.8 


Part College 01 


• better edua 


ition 


2.8 


2.4 


1.6 


1.3 


3.9 


Median Grade 


at leaving sc 


hool 


8.30 


8.39 


8.43 


8.24 


8.51 


Median Grade 


of Jour. +E 


3q)erts 


•• 


•• 


•• 


8. 
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were specialists on the carburetor work of gasoline motors for 
automobiles. 

The number and percentage distributions of the tradesmen 
by grade at leaving school and by trade status, are shown in 
Table I. For comparison with the results for all 924 men 
(coltunn 6) are also shown the percentage results from 9,506 
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unemployed men (column (5) previously reported.^ The 
median grade of the employed men is found to be only 0.09 
grade higher than the unemployed median. This might seem 
to point to no very great difference between the two groups. 
We have also previously pointed out the great stability of 5ie 
medians of such large educational groups, and the significance 
of small changes in the median as well as the necessity of bas- 
ing our judgment upon the actual distribution rather than the 
central tendency.' By plotting the percentages of columns 
5 and 6, we obtain the curves of Graph I. We note the great 
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inferiority of the unemployed group up to about the middle 
of the fifth grade shown by the large percentages of unem- 
ployed in the lower grades as compared with the percentage 
of employed in these same grades. The ratio of the two 
series of percentages is the real comparative measure of the 
two groups. Almost twice as many unemployed men leave 
school at each grade up to grade five as of employed men. In 

1 Toops, H. A. and Pintner, R. — Mentality in Its Relation to Elemi- 
nation from School. School and Society, Vol. VII, Nos. 174-175, pp. 
507-510, 534-539. April-May, 1918. 

2 Toops, H. A. and Pintner, R. — ^Variability of the Education of Un- 
eemployed Men. Journal of Applied Psychology, Vol. II, No. 3, Sept 
1918, pp. 207-218. 
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consequence of this, there is a much larger percentage of 
employed men than unemployed leaving at the eighth grade. 
In terms of ratios of percentages, the differences of the two 
groups at the eighth grade is much less significant than the 
difference between the two groups at the third grade. In the 
higher grades the differences are not so striking. Curiously 
enough, the " psychology of completion "' is much more 
marked at the seventh grade in the case of the employed men 
than the unemployed men, as we might expect. 

By plotting the percentage distributions of the trade classes, 
we find rather marked educational differences as shown in 
Graph II. The amount of school elimination for apprentices 
is very similar to that of experts, and there is much over- 
lapping of these two curves. In the case of the journeymen, 
we find a marked differentiation between this class and the 
other two classes. The journeymen have distinctly more elimi- 
nation in the lower grades and much less in the higher grades, 
thus proving them to be, as a class, quite inferior to experts 
in the amount of education attained. This fact is also indi- 
cated by their median, 8.24, which is the lowest of all three 
medians as shown on Table II. The median of the appren- 
tices is lower than that of the expert, as we should expect, if 
education has an)rthing to do with trade success. The appren- 
tices, by reason of being beginners in the trade, must contain 
both potential experts and also those who, even with the 
requisite amount of years of experience' in the trade will not 
become experts. The effect of the "psychology of comple- 
tion " is quite marked in the case of the joume)rmen only. 
Instead of this, we notice in the elimination curve an entirely 
new phenomenon, namely, a sudden rise in elimination in both 
apprentices and experts at the II grade of High School. Such 
irregularities in the curve may of course possibly be due to. 
the comparative smallness of the numbers involved; the pos- 
sible significance of these, should they prove to be real phen- 
omena peculiar to these classes, will be discussed later. Ex- 
perts and apprentices differ mainly from the journeymen in 
the relatively low proportion of poorly educated men and the 
relatively high proportion of better educated men with respect 
to the corresponding journeyman percentages. 

The median grades by trades and the number of cases on 
which these are based are shown in Table II. The variation 
of the medians is not great, the range being only about three 
grades. In the division by trade status, in only one class, 
Journeymen, is the average deviation of the individual trade 

» Cf. Op, cit. in Footnote i. 
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Table II. Distribution op Cases by Trades; and Median Grades 
BY Trade Classes and by Trades 



Tirade 



Value Total A J 



Rank 



Number of Cases 



Median Grade* 



E ITotal 



Horseshoer. . . . 

Cobbler 

B]acksmith(Shop) 

Bricklayer — 

Lineman(Telei^) 

Carpenter 

Locomotive Re- 
pair 

Harness Maker. . 

Bench Hand 

Steamfitter 

AutoTruckMech 

Typewriter Re- 
pair 

Sturc. Steel Erec. 

Sheetmetal Work 

Poweiiiou8e(A.C.) 

I\werhou8e(D.C.) 

Tooknaker 

Plumber 

Vulcanizer 

Motor Repairer. . 

Elec. Inst. Rep'r. 

Inside Wireman.. 

Gen. Auto Repair 

Patternmaker. 

Ammonia Pipefr. 

Lathe Hand. . . 

Motorcycle Rep'r 

Storage Batym n. 

Switchboard Re- 
pairer 

Carburetor Man. 



9.5 
9.5 
9.5 
9.5 
9.5 

9.5 
14.5 
14.5 
14.5 
14 
17 
20.5 
20.5 
20.5 
20.5 
20.5 
20.5 
24.5 
24.5 
26.5 
26.5 
28 

29 
30 



9 
21 
18 
53 

54 
42 

33 
10 
43 
27 
45 

30 
20 
16 
47 
38 
50 
47 
18 
38 
20 
43 
40 
40 
17 
25 
17 
19 

31 
9 



2 
5 

i2 
14 
14 



15 
16 
12 

4 

1 

3 

13 

12 

24 

12 

4 

13 

13 

11 

14 

18 

3 

8 



6 

5 

9 

20 

12 

19 

17 
2 

15 
1 

18 

10 

6 

6 

16 

16 

14 

15 

2 

14 

3 

19 

11 

14 

10 

8 

7 

4 



1 
11 

9 
21 
28 

9 

16 
8 
13 
10 
15 

16 

13 

7 

18 

10 

12 

20 

12 

11 

4 

13 

15 

8 

4 

9 

10 

15 

14 
9 



8.3 
8.4 
8.6 



8.4 
8.2 
8.1 



6.7 
7.9 
8.3 
6.5 

6.8 

S.3 

8.2 

8.4 



8.2 
8.4 
8.6 
8.8 



8.3 
8.1 
8.2 
8.5 



I.O 
8.3 
8.5 
8.5 
8.8 

ii;2 



8.4 

S.i 
8.5 
8.8 
8.9 
8.6 
8.8 



III.O 



1.3 



7.5 
8.3 
8.0 
8.1 
8.4 

8.7 
8.3 
8.5 
8.4 
8.8 

8.4 
8.4 
8.6 
8.8 
8.9 
8.8 
8.6 
8.6 
8.5 

li.O 
8.9 
8.9 

li.O 
8.9 
1.5 

8.9 

no 



7.0 
7.3 
7.5 
8.0 
8.2 
8.2 

8.3 
8.3 
8.3 
8.3 
8.3 

8.3 
8.4 
8.4 
8.4 
8.4 
8.5 
8.6 
8.6 
8.6 
8.6 
8.6 
8.6 
8.7 
8.7 
8.8 
8.8 
1.5 

1.6 

n.o 



Total*— All Trades 



920 252 307 361 



8.43 



8.24 



8.51 



8.39 



Average Deviation 



0.430.53 0.43 0.38 



* Median not calculated for less than 7 cases. 

* One trade with only 4 cases not included in this table. 

medians from the median of all the men in the status, irre- 
spective of trade, more than one-half a grade. We note also 
that the deviation of the total 924 men by trades from the 
median of the whole is less than any of the classes. This is 
one more indication of the remarkable stability of the central 
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tendency of education when large groups of men from many 
trades are considered ; or in other words, the more nearly we 
approach an unselected sampling of the total population. 

One may quite reasonably ask whether these results are 
based on a sufficiently large enough number of cases, and 
whether there actually exist such basic differences in the 
schooling of different tradesmen, as to consider the median 
grade a reliable index. After the results of the thirty-one 
trades had been tabulated, similar results were secured for 
six trades in a city in a different part of the country. Two of 
these trades, cook and brass melter, were not included in the 
30 trades studied, and data were also secured for these at the 
first city, designated as City A. The resulting medians, given 
in Table III, suggest that even in widely different parts of the 
country, the medians by trades are not apt to vary on the aver- 
age more than 0.3 of a grade. Those trades were selected 

Table III. Reliability op Trade Median Grades 





City A 


City B 


Trade 


Cases 


Median 


Cases 


Median 


Horseshoer 


9 
9 
18 
38 
20 
21 


7.0 
II. 
7.5 
8.6 
8.1 
7.5 


12 
21 
13 
17 
37 
30 


7 4 


Carburetor 


II. 3 


Bl^ctr^apHH 


7 3 


Motor Repairer 


8 5 


Cook* 


8.0 


Brass Melter* 


6 9 







* Data received too late to be included in Tables I, II, and IV. 

which showed graduated differences in median from lowest to 
highest in order to test out whether the same significant range 
would be found at City B. 

If we examine carefully the medians of Table II in the light 
of our knowledge of the trades, we may draw several conclu- 
sions therefrom. 

In verification of the general results that journeymen are 
more poorly educated than either apprentices or experts as 
shown by the medians of the classes, we find that in 9 or three- 
fifths of the trades for which the A, J and E medians are cal- 
culated, journeyman medians are the lowest of the three. In 
17 or 85 per cent, of the trades in which both J. and E medians 
are calculated, the journeymen tradesmen are less well edu- 
cated than the experts. 
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In those trades in which the expert has a radically different 
line of work from the apprentice, the experts are much better 
educated. Examples are the auto truck mechanics in which the 
expert usually is a foreman of a general auto repair business 
including touring cars, and the two powerhouse trades in which 
the expert is usually a dynamo tender as well as a switchboard 
tender. 

In trades involving great personal discomfort we are likely to 
find the general education low. Examples are the trades of 
brass melter, cook, blacksmith and horseshoer. In each of these 
trades we find a poor general education, and in each the per- 
sonal discomfort due to heat is well marked. We believe that 
men are attracted toward the cleaner, more comfortable and 
better paid trades, and that the better educated are somehow 
able to secure the majority of these jobs thus forcing the less 
well educated to take the more undesirable jobs. In such 
trades, when work is plentiful, we find only the poorest type 
of apprentices entering the trade. Not one of the apprentice 
cooks or brass melters in City A, and only three cooks in City 
B, came up to the median of the trade as a whole. In the 
blacksmith and horseshoeing trades, two trades with low edu- 
cational attainments as well as low wages, there have been 
practically no apprentices learning the trade during the past 
several years. 

Relation of the Grade At Leaving School to the Average Kind 
of Trade Cltaracteristic of the Grade 

From the medians of Table II, we are able to see that there 
is some relation between the grade at which a boy leaves school 
and the trade which he enters. We wish now to secure some 
measure of that relation. 

In order to do this, the trades were arranged in order of 
their total median grades, and rank values were given to each 
trade as shown in the second column of Table II. Horseshoers, 
with the lowest total median is given the rank, 1 ; carburetor 
man, at the other end of the range, is given the rank of 30. 
Then, from the crude number distribution by grades and by 
trades was calculated the average trade rank of each grade. 

The sampling is of course quite small in the very lowest and 
very highest grades, and could undoubtedly be improved by 
securing larger numbers at these grades. From the results of 
the above computation, the average trade entered by third 
grade men may be assumed to be about that below structural 
steel erecting, if we consider the number of cases large enough 
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Grade III Has 11 Cases As Follows 
No. of Trade Trade 

Cases Rank 

1 Cobbler 2 

2 Carpenter 5.5 

2 Switchboard Rep 29 

2 Telephone Lineman 5.5 

1 Locomotive Repair 9.5 

1 Elec. Inst. Repair 20.5 

1 Inside Wireman 20.5 

1 Powerhouse A. C 14 .5 

11 

Average 



Product 
Casesx Rank 

2.0 
11.0 
58.0 
11.0 

9.5 
20.5 
20.5 
14.5 



147.0 
13.4 



to justify such a conclusion. The average trade by grade, the 
average deviation in trade rank from these averages and the 
number of cases upon which they are based are all shown in 
Table IV. We note a general tendency of these average 
trade ranks to increase with increase in the amount of educa- 
tion as we should expect. If the relationship were a perfect 

Table IV. Correlation op the Average Trade Per Gr\de with 

THE Grades 





To 




Average 


Number 


Grade 


Correlate 


Average 


Vi= 


of 




with rank 


Trade 


Deviation 


Cases 


None 





11.6 


8.7 


9 


1 


1 


10.5 


6.7 


3 


2 


2 


13.3 


5.2 


6 


3 


3 


13.4 


8.4 


11 


4 


4 


10.1 


5.0 


26 


5 


5 


10.0 


5.0 


43 


6 


6 


12.9 


6.6 


108 


7 


7 


12.8 


7.0 


91 


8 


8 


14.7 


6.6 


417 


IH.S. 


9 


20.1 


5.7 


56 


II H. S. 


10 


22.6 


6.4 
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16.3 


5.7 
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... 
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one we should have, as the simplest (example), a straight line 
curve when these averages are plotted against the grades 
themselves. When, however, we plot these (Graph III) we 
find much deviation from a straight line, due perhaps in some 
cases to the smallness of the numbers and also to the fact 
that we should actually expect more deviation at the extremes 
of the series if the grade at leaving school is the result of more 
than one factor as it is known to be. Not only should these 
averages be such that each succeeding one should be larger 
than the preceding but they should be in some series order, 
the simplest of which is of course an arithmetical series, or 
0, 1, 2, 3 — 16 order. One measure of this is a correlation 
ratio. The Pearson correlation, r, between this arithmetical 
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series and the average trade values by grades is 0.79 with a 
probable error of 0.06. 

By employing the method of least squares, we may give 
large amount of weight to the extreme deviations which seems 
desirable, and may determine a straight line equation which 
will best fit the defective data at hand. 

The equation of the line of least square deviation is 
y = 9.51 +0.84 X. This line is plotted on Graph III. 

Mentality and its Relation to the Trades and Trade Status4 

We have previously pointed out the probable close relation- 
ship of mentality to education. In the present work we have 
often felt convinced that the only diflference between many 
joume)rmen and experts was one of intelligence. This is often 
so considered by the foreman in charge of the men. A few 
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quotations of foremen are here given as examples of the lay- 
man's method of expressing the mental disabilities well known 
to the clinical psychologist by other terms : 

" He makes good journeyman wages and works all 
right as long as the machine works all right ; but if any- 
thing goes wrong, he can't fix it." 

" He hasn't the head for an expert, although he is just 
as good a workman as this other man (an expert)." 

" This man works all right so long as I tell him what 
to do." 

" He isn't * all there ' when it comes to doing new jobs." 

" The man can work all right as long as he is told what 
to do but he can't reason out things for himself." 

" He can follow a drawing all right, but he can't figure 
out things." 

If we examine certain of our medians we may get some 
interesting light on the practical nature of the differences 
between the different trade classes. 

The median grade of journeymen plus experts is 8.38; that 
of joume)rmen plus experts plus apprentices is 8.39. This sug- 
gests that journeymen and experts are but later differentia- 
tions of the one class, apprentices or beginners, the better edu- 
cated class falling in general into the expert group and the 
poorer educated class falling into the joume)rman group. 
Furthermore the median of journeymen plus experts (8.38) 
is an exact average between journeymen and experts (8.24 to 
8.51). This suggest that journeymen may also be further 
split up into two classes. For, if the average of the median of 
309 J + median of 363 E = median of the distribution of 672 
journeymen and experts combined as one distribution; then, 
since, only if there were a real basic difference in the education 
of journeymen and experts and equal numbers of each if the 
groups were normal groups, would this relationship hold true, 
a plausible explanation under the circumstances is that the 
journeymen are made up of an undue proportion of the poorer 
educated which may arbitrarily be considered as one class, 
and of a small proportion of better educated men which may be 
considered another class. 

In the light of the foregoing opinions of foremen we would 
interpret this as indicating two classes of mentality to be dis- 
tinguished among the journeymen; first, those of high men- 
tality who are classed as journeymen merely because of having 
not yet had sufficient vears experience to be classed as experts, 
and secondly those "(loomed to be journeymen all their days." 
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If, then, we should exclude from the journeyman median those 
who are future experts in embryo, we should find a much 
lower median of education of the remaining class. 

Greater average deviation by trades (Table II) from the 
median of the status would seem to indicate that the journey- 
man period is a period of adjustment of the workmen to jobs. 
The poorer educated and more poorly mentally endowed, after 
a few years of trial at work b^^n, we must think, on a more 
or less hit-and-miss principle of trade selection, are forced by 
the competition of better educated and better mentally endowed 
men to make new adjustments to their industrial life when 
time has given opportunity for their mental shortcomings to 
become apparent. At least one large industry of the country 
removes from the payroll any min who fails to progress be- 
yond a given point in learning the trade and is not thus con- 
tinually becoming more useful to the company. The mentally 
inferior are thus practically forced to accept the less desirabte 
and less responsible positions. 

The curves of Graph II, while not based upon a sufficient 
number of cases to be taken as positive evidence, seem pos- 
sibly to indicate that the conflict between mentality and ability 
to progress well in school work comes later, on the average, 
in the case of apprentices and experts (about I or II H. S.) 
than in the case of journeymen. The peculiar rises in the 
elimination curves of the apprentices and experts at II H. S., 
a phenomenon not previously noticed and also absent in the 
case of the journeymen, while the ordinary 6 and 7 grade 
peculiarity is absent in both the expert and apprentice 
curves, would certainly indicate such a conclusion if the exist- 
ence of these peculiarities in the curves should be confirmed by 
future investigation. 

Unemployed men have several times been shown to have 
lower mentality than the population taken as a whole. Since 
these differ presumably from the whole population in educa- 
tion mainly in the greater proportion of poorly educated men 
we conclude that the unemployed group contains an undue 
proportion of the " doomed to be journeymen " class of men. 
Periodical calls at the employment office is thus but one of the 
incidents in the life of such unfortunate individuals that 
serve to indicate to the outside observer the readjustment of 
mentality to the demands of the trade. Of men who change 
their trade after a few years work we should expect the larger 
part to take up new trades of a similar character. Those who 
do so would be the class with the greatest amount of mental de- 
ficiency. We believe that the better endowed man is more apt 
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to remain in even a very 'simple trade when he discovers that 
he has entered a trade not requiring all of his mental ability, 
for the simple reason that on account of that superior ability 
he is able to make rapid progress in the trade and win pro- 
motion rapidly. This is a problem for future investigation. 

Relation of the Education of Tradesmen to That of the Prch 
fessions and of Laborers. 

The best known professions are quite commonly recognized 
as requiring a college degree as a necessary prerequisite for 
entrance into the profession. The semi-professions would also 
tmdoubtedly rank high in educational attainments. 

The education of laborers in its relation to that of trades- 
men is not so clearly apparent from merely our knowledge 
of the arbitrary standards demanded, as for example, of any- 
one who would follow the professions. Laborers require 
surely the least of knowledge gained from school study. Do 
then the ranks of the laborer contain only men of a small 
amount of education, or do they contain as well many men of 
a fair or very large amount of education? 

In an attempt to answer this question, we present here the 
tabulated results by grades of 50 each white and colored 
laborers chosen at random from the files of the Personnel 
office,, Camp Dix, New Jersey.* 

Percentage DiSTRraunoNS by Grade at Leaving School of Fifty 

Each White and Colored Laborers at Camp Dix, New Jersey 

Pfer Cent at Grade:— 

CokM- None 12 3456781 II Total Median 

Grade 

White 56 14 6 14 6 2 2 100 0.91 

Q^ored 44 16 8 10 2 6 6 4 2 2 100 1.44 

Both 50 15 7 12 4 4 3 3 1 1 100 1.00 

. The results here presented may be too low for laborers in 
general, due to the fact that most of the white laborers were 
foreigners, and also to the fact of the great demand at this 
time for men of fair ability in the more skilled trades. These 
together account for the lower median grade of the white 
laborers. Native bom white laborers may be expected to have 
a slightly better education perhaps than that here indicated 
for the colored men. 

The data is quite conclusive evidence that the occupation 
of laborer, the one requiring least skill and ability, is held 

^ We gladly acknowledge our indebtedness to First Lieutenant £. S. 
Gregory, Jr. for his cooperation in securing this data. 



Digitized by 



Google 



46 TOOPS AND PINTNER 

generally by persons of very inferior education. Eighty-eight 
per cent of the laborers have less than a fifth grade education 
On the other hand, over eighty-nine per cent, or a larger per- 
centage, of all the tradesmen are found with an education 
equal to or better than a fifth grade education. 

Industrial Selection of Men and Trade Guidance by the 
Amount of Education Attained. 

From the employer's point of view, of two men of equal 
skill and trade ability (irrespective of years of experience) 
the more valuable man would ordinarily be the more intelli- 
gent one. Given equal chance to learn the trade, this would 
ordinarily mean the man who could learn the trade more 

Juickly. In some cases, however, there is a distinct demand 
or the moron type of individual. " He is better satisfied and 
will take more from his foreman." In such cases High School 
graduates would scarcely be in demand at all. A low degree 
of education would usually pick out such an individual; this 
however, is seldom needed as it is usually possible to pick out 
the extreme types of intelligence by simple methods much 
better than by the criterion of education. 

In those trades demanding a high degree of skill and respon- 
sibility, high school men would seem to be desirable. Our 
figures show that in only 41 per cent of the trades considered 
are there more than one-fourth of the men in the trade who 
have even entered high school. Of the experts, in 55 per 
cent of the trades have one-fourth or more of the men entered 
high school. This clearly indicates where "expert timber" 
is grown in greatest abundance. Of the journeymen, only 27 
per cent of the trades have one-fourth or more of their men 
who have entered high school. 

Only 14.9 per cent of journeymen have some high school 
education, while 27.8 per cent, or nearly twice as many, ex- 
perts have some high school education. The experts exceed 
the apprentices by only 3.6 per cent on this score, due no doubt 
to the fact that many of the better educated men reaching the 
expert class go even higher into the executive positions where 
they are no longer considered tradesmen in the ordinary sense 
of the term, a man toiling at a trade. These figures are such 
as to further confirm our belief that among the journeymen 
we find a smaller percentage of well educated men. 

From the percentages of Table I, we can, by comparison of 
the journeyman and expert percentages, roughly predict what 
will be a boy's chances, on the average, of eventually becoming 
an expert or of remaining a journeyman if he leaves school 
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at a given grade. The percentages for the journeymen arc 
probably too low in the lower grades for an exact determina- 
tion of this as has already been pointed out. If we plot the 
percentages of Columns 8 and 9 of Table I as percentages of 
their sum, we secure the curves of Graph IV. The curve, Exp. 
represents the number of chances out of one hundred a boy has 
of becoming an expert if he leaves school at a particular grade. 
The curve, Jour., gives the same for his chances of becoming 
and remaining a journeyman. This data can also be subjected 
to the methcMd of least squares whereupon we secure the 
straight line equations, T-e and T-j, (Graph IV) which are 
perhaps as representative of the facts, and are much simpler 
to comprehend. By reference to these curves, we may say that 
if a boy leaves school before the seventh grade, the chances 
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are greater that he will be a journeyman than that he will 
become an expert, the chances of permanently remaining a 
journeyman being greater the less education he has. After 
the seventh grade, where the chances are about even, the 
chances for eventually becoming an expert gradually increase 
until in about four out of every five cases will a college 
graduate become an expert. Were the percentages of Table 
I corrected so as to include in journeymen only those " doomed 
to be journeymen " we might expect the true position of the 
curves, T-j and T-e, to assume somewhat the positions of 
the dotted lines of Graph IV. 

Trade Education of the Men Examined. 

Few of these men had any original trade instruction. Such 
trade instruction as they received was largely at the hands 
of hard experience or of still more exacting and unappreda- 
tive foremen. The method of instruction is left almost wholly 
to the shops themselves. Such instruction must then neces- 
sarily be more or less of the same calibre as the men who work 
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at the trade and who instruct the incoming apprentice. The 
writers have become quite convinced that the time required to 
produce a journeyman workman — five years in many cases — 
is entirely too long with men of average intelligence. Not only 
could the average person learn the trade much quicker than 
this if given the opportunity, but in many cases he is prevented 
from so doing by a lock-step system of apprenticeship. The 
successful experiments now being undertaken by the War 
Department, wherein men of fair intelligence and general 
training are taught just such trades as these in short courses 
is well worth watching by our educational and industrial 
leaders. 

We have the testimony of the educational director of one 
of the largest industrial concerns of the country to the effect 
that " a two year apprentice with organized school-shop 
instruction can not only produce as good work as a five or six 
year journeyman without the instruction but he is more valu- 
able to the company because he knows " why he does things." 
Or as another very intelligent foreman expressed it, " the real 
expert is the man who can run a machine when the machine 
fails to work ; anyone can run a machine when the machine is 
working properly. The expert knows the 'why' of the 
machine." Perhaps the first man overlooked the fact that 
many of the boys who come into his hands are the boys of 
better intelligence to begin with and would have done fairly 
well without the school-shop instruction, as this company is 
rather careful in choosing its employees. The second man 
may have under-estimated the value of the human element in 
the production with " things going well." 

Inasmuch as most men differ greatly in their rates of learn- 
ing the "why" rather than in their ability to eventually 
learn these comparatively simple trades, it seems quite evident 
that organized trade instruction in the shops or in the schools 
would do much to alter the proportion of the journeymen and 
experts with the favorable balance on the expert side. 

Finally, if the results found for the education of laborers 
be taken to represent the education of laborers in general, and 
if those found for tradesmen be taken to represent the educa- 
tion of tradesmen in general, we can see the broader relations 
of education to the three divisions of occupations as laborers, 
tradesmen and professional men. A boy with no education at 
all, or even with as much as a third or fourth grade education 
is practically condemned to the life of a laborer. From a third 
or fourth grade education on up but with less than a seventh 
grade education the chances for his becoming a journeyman 
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tradesman only, are greater than his chances of becoming an 
expert tradesman. With better than a seventh grade educa- 
tion his chances are greatly in favor of eventually becoming 
an expert tradesman. And, finally, if he would be a profes- 
sional man it is necessary that he acquire a college degree. 
That these statements are true only for the general tjrpe of 
man found in these divisions is clearly apparent. No one at 
all acquainted with the general type of laborer would maintain 
that by spending twenty years in an effort to educate him 
through college could one make a professional man out of him. 
He lacks the general intelligence of the professional man. 
And, on the other hand, not all men with college degrees make 
successful professional men, nor even always successful 
tradesmen ; nevertheless a college degree is generally good in- 
dustrial instirance. 
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PRINCIPLES UNDERLYING THE CLASSIFICATION 

OF MEN * 



By Truman L. Kellby, Teachers College Columbia University. 



Part I. 

The opportunity to appear before this body suggested 
making a report upon some one of the phases of army work 
with which I have been connected, or of presenting certain 
conclusions and principles which have been developed or 
strengthened by my total War Department experience. I have 
chosen the latter course because I believe my report will be of 
more value if I present some of the principles of selection 
underlying war procedure which are equally applicable to 
peace conditions. My experience in connection with tests for 
illiterates, trade tests, and the selection of ground and flying 
school men, entirely supports the conclusions which will be 
reported, but I shall choose another field, that of selection of 
officer material from S. A. T. C. units, to illustrate the points 
made, because, in my judgment, the principles adopted m the 
selection and classification of S. A. T. C. men are in advance 
of those used in any other field of classification. The problem 
of classification in the Students Army Training Corps fol- 
lowed directly from its main purpose which was to provide 
for the securing of material fit for officer training. 

It was anticipated that from thirty to forty thousand men a 
year would be selected from the S. A. T. C. units for transfer 
to training in officers' training camps. Not only was it neces- 
sary to select these men, but it was desirable to assign them 
for training to those branches for which they were best fitted 
and in which they were most needed. 

Had proverbial methods for handling a case like this been 
followed each corps would have conducted a separate and 
intense recruiting campaign in the S. A. T. C. units — ^the corps 
first on the field or the one that held out the most alluring 
picture of th^ life of its officers getting the creaih of the men, 
to the disadvantage of other corps and resulting in a net de- 

^ Part I was first presented in an addresss delivered at the Baltimore 
meeting of the American Psychological Association under the title 
" Principles Underlying the Classification of Men in the Students Army 
Training Corps." Part 2 is presented here for the first time. 
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crease in the efficiency of the army as a whole. It would also 
be expected that in lieu of objective methods personal bias of 
one sort or another would be largely operative in determining 
recommendations for officer training schools. 

In addition to securing general officer material it was con- 
templated that quite a number of specialists, bacteriologists, 
chemists, ordnance experts, etc., would be drawn from the 
S. A. T. C. ; also, that thirty or forty thousand men fitted for 
training in schools turning out non-commissioned officers 
would be found and that those remaining after these selections 
would be assigned as privates to regular line units. 

This was the situation which Dr. Thomdike was called upon 
to solve. Accordingly the scheme which he drew up aimed to 
do the following things : 

1. Pick specialists. 

2. Divide the soldiers into three parts upon the basis of 
general merit as officer material, the upper part going to 
officers' training schools, the middle part to non-commissioned 
officers* schools, and the least meritorious part to camps, con- 
tinuing upon the status of privates. 

3. To do away with the necessity of each corps conducting 
a separate recruiting campaign. 

4. To reduce to a minimum the tendency to exercise per- 
sonal bias. 

5. To be just to the soldiers, both from the standpoint of 
their abilities and from that of their interests. 

6. To determine scores for each man selected for officer 
material indicative of his respective degrees of fitness for the 
different branches of the army. 

7. To lead to an allotment of officer material to the different 
branches which both in number and quality would be appro- 
priate to their needs. 

The solution to so complex a problem demanded a pro- 
cedure involving the closest synthesis between the abilities of 
men, the special needs of different branches of the service, and 
the numbers required in the branches. 

The determination of whether a man is possessed of the 
special training necessary to fill a specialist job is not a difficult 
task, so that it was relatively easy to provide for the selection 
of these men. According to Dr. Thomdike's scheme, these 
were to be selected before the further classification was done. 

The division of the remainder of the soldiers into three 
groups, and their classification for different branches, depends 
upon securing accurate ratings upon traits essential to general 
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fitness and distinctive of such capacities as are especially 
required in the different branches of the army. Dr. Thorn- 
dike's original plan, therefore, provided for rating a man in 
the following twelve qualities: 

1. Command of men 

2. Popularity 

3. Military studies 

4. Military practice 

5. Intellect, including academic studies 

6. Athletics 

7. Athletic — ^mechanical ability 

8. Business ability 

9. System 

10. Physique 

11. Qiaracter 

12. Scrupulousness 

These qualities were chosen because (1) each one was 
essential in at least one of the branches of the service for 
which selection was to be made, (2) it was possible to secure 
fairly reliable ratings for each of them, and (3) in the main 
they measure quite discrete talents. Due to the withdrawal 
of certain branches of the service from those drawing from 
the S. A. T. C. the number of traits was later reduced to 
seven as follows : 

1. Intellect, including academic studies 

2. Character 

3. Military studies and practice 

4. Physique and athletics 

5. Command of men 

6. Athletic-mechanical ability 

7. Scrupulousness 

In order to secure ratings upon these traits provision was 
made for a Rating Board, and in order that the rating should 
be as reliable as possible these principles served as a guide in 
determining membership and procedure. 

1. An average of a number of ratings is more reliable than 
a single rating and is less liable to be determined by personal 
bias. 

2. An average of independent ratings is more significant 
than a concensus of opinion reached after discussion. 

3. In order to be accurate, ratings must be made by men 
who are intimately acquainted with the daily lives of those 
rated. 
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4. In order to be amenable to interpretation, ratings when 
made by different men must be upon the same scale. 

In order that men with the peculiar talents necessary for the 
different branches should be so assigned, a bidding for talents, 
i. e., for the twelve traits listed above, by the officers in charge 
of recruiting in the different branches, was secured. Eadh 
branch was entitled to one hundred units of talent and could 
divide them among the twelve traits listed in such proportion 
as it judged to be most advantageous to the particular needs 
of its corps. 

Each man was given a score in each branch of the service, 
which was the stmi of the products of his scores in the various 
traits and the bids for these traits as made by each corps. To 
these certain amounts were added on account of the man's 
individual preference, resulting in final fitness scores for each 
branch. 

Finally an allotting plan provided in substance for the 
assignment of each man to the branch for which he was best 
fitted, unless the quota in such branch was filled, in which case 
he was assigned to the branch for which he was next best 
qualified. 

This brief outline presents the problem which demanded 
solution and the principles which were quite evidently followed 
by Dr. Thomdike in meeting it. With this concrete plan be- 
fore us we may turn to a consideration of such principles of 
selection as are universally sound. 

Accurate classification depends upon the securing of such 
measures of fitness, before the men have been called upon to 
demonstrate their fitness by actual performance, as will corre- 
late highly with the excellence of the later performance. The 
only method of proving that the classification is accurate is 
by finding a high degree of correlation between the diagnostic 
measure and the measure of performance. 

But before there can be proof there must be something to 
prove and it is with a view to suggesting kinds of tests and 
measures that offer such promise as to make it worth while 
to test them out, that the factors making for high correlation 
will shortly be enumerated. 

I would ask you to note that the method of proof is straight- 
forward and )rields conclusive evidence, and in order to keep 
the issues of this paper perfectly dear it is hereby disclaimed 
that any of the principles presented for judging of the appro- 
priateness of diagnostic measures provides a second meUiod 
of proof. They constitute suggestions as a guide in drawing 
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up tests in the first instance and criteria to use in estimating 
the excellence of measures where proof is impossible. 
' The facts of partial correlation show us that when measures 
of any sort are used together, i.e., their results summed, to 
obtain a single score diagnostic of some ability, three condi- 
tions as to the relationships of the separate measures deter- 
mine their excellence. These conditions determine the mag- 
nitude of the partial correlations between the separate tests 
and performance, and are, other things being equal, (1) the 
higher the reliability coefficient of the test or measure the 
better, (2) the higher the correlation between the measure and 
performance the better, and (3) the lower the correlations 
with the other measures with which it is to be combined the 
better. More briefly; high reliability, high correlation with 
demonstrated efficiency, and low intercorrelations are the char- 
acteristics of a good diagnostic measure. This can be made 
clearer by an illustration. 

Suppose the capacity to be measured is fitness for training 
as an infantry officer. Suppose scores in the following have 
been suggested as constituting a good set of diagnostic meas- 
ures: (1) school marks; (2) teachers' estimates of general 
intelligence; (3) drill masters' estimates of courage; (4) drill 
masters' estimates of ability to command men; (5) grades 
received in military drill; (6) teachers estimates of character; 
and, (7) estimates made by students themselves of the degree 
of their interest in performing the duties of an infantry officer. 
The significance of each of these measures can be determined 
if records showing efficiency in a camp for infantry officers 
are available, in the case of men for whom the above scores 
were determined. The existent conditions of reliability, cor- 
relation, and intercorrelation determine this significance for 
each of the tests. For example, if the estimates of general in- 
telligence are (a) fairly reliable, (b) correlate quite highly 
with demonstrated efficieacy and (c) correlate still more 
highly with school marks and estimates of character and quite 
highly with the remaining four traits, they will turn out to be 
fair or poor, but not good measures for the purpose in hand. 
It is the high intercorrelations which prevent their being ex- 
cellent measures. 

These well known facts of partial correlation have been 
dwelt upon because they furnish the key for judging of the 
value of a test when the measures of demonstrated fitness are 
not available. It is probable that it is always possible to make 
more accurate estimates of the reliability of a test, its correla- 
tion with the ultimate criterion, and its intercorrelation, than 
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it is to estimate directly its value as a diagnostic measure. Thus 
if it is impossible to secure demonstrated fitness measures, and 
therefore the only method possible is that of estimating sig- 
nificance, a very much more reliable estimate can be made if 
it is based upon three estimates — one of reliability, one of cor- 
relation with the criterion, and one of independence — each of 
which is more or less within the experience of one familiar 
with test and mental relationships, than if made independently. 

This guessing method however can usually be improved 
upon, for generally actual coefficients of reliability and co- 
efficients giving the intercorrelations are easily secured, even 
when it is out of the question to secure measures of correlation 
with real efficiency. In this case estim^s as to the latter only, 
need to be made. 

At times a knowledge of. reliability and intercorrelation may 
solve the whole problem so far as the single test is concerned. 
If, in the example cited, the coefficient of reliability for esti- 
mates of courage should turn out to be .10 or less — and the 
determination of this coefficient is a very simple matter — 
these measures can be immediately discarded as being practi- 
cally worthless ; and this in spite of the fact that courage itself 
may be the most important trait for an infantry officer to 
possess. Again, if the correlation between drill masters' esti- 
mates of ability to command men and grades received in mili- 
tary drill should be .95 or above, it would be immediately 
apparent that nothing was to be gained by keeping both meas- 
ures and one could be discarded. 

Without stopping to consider each of the seven traits, it may 
be pointed out that probably the estimates of interest made 1^ 
the students themselves stand high as judged by each of the 
three criteria and accordingly such estimates niay be expected 
to be highly important in diagnosing fitness for officer training. 

The problem cited, tho neither more nor less difficult than 
the ordinary vocational selection problem, shows the difficulties 
in approximating, without knowledge of the partial correla- 
tions, the importance of a measure. Too many relationships 
are involved to permit of a really accurate evaluation by means 
of logical analysis alone. But, as mentioned, the attempt to 
estimate and interpret all the relationships relevant to partial 
correlation is particularly serviceable in suggesting measures 
which may be expected to prove valuable, since of course a 
method involving proof is not available at this stage of the 
procedure. 

To this point I have considered the means of determining 
the excellence of measures of individuals as evidence of fit- 
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ness for some one particular job. I shall now consider the 
excellence of measures of success in jobs as evidence of the 
possession by individuals of certain traits. Before,, the ques- 
tion was to judge of the probable degree of success in a job 
of a man with certain known, i. e., measured traits ; now the 
question is to determine the probable degree in which a trait 
is possessed by a man who has known measures of job suc- 
cesses to his credit. This question is not merely an academic 
one, for it must be solved in some way wherever a certain 
number of men are to be allotted to a number of different jobs. 
The principles of partial correlation are operative here as 
before. Just as a number of men with various standings in 
several traits show different degrees of efficiency for one job,^ 
so one man will show different degrees of efficiency in a 
number of jobs. The method of determining which of the 
several jobs he will best fit is in theory just the same as the 
preceding, interchanging the variables. In actual working out 
it would not be as simple as implied but the details need not 
here concern us. 

If the two processes are welded into one and made a single 
analytical function we have the solution to just such a problem 
as that of a firm having 100 vacancies in different departments 
to be filled by 100 men, each man being sufficiently meritorious 
to warrant some position. 

If the vacancies are all of equal importance the best solution 
would be that which would result in the minimum number (or 
more accurately amount) of displacements of the 100 men — 
displacements- to be measured in some such way as the number 
of transfers from one position to another until a position is 
found which is filled in an excellent manner. As positions 
ordinarily are not of equal importance, but roughly of an im- 
portance represented by the salary paid, a dose approximation 
to the best placement of the men would be that which would 
result in the minimum number of dollar displacements — a 
dollar displacement being obtained from individual displace- 
ments by multiplying each of the latter by the respective 
salaries involved. It is obvious that some such weighting of 
individual misplacements is needed for it is much more serious 
for a $25 a day executive to be in a position that he is not fitted 
for than for a $1 a day messenger to be so placed. The problem 
can be readily expressed in terms of the method of least 
squares, or minimum errors, tho its solution statistically is, 
complicated. 

Through the genius of Dr. Thomdike a solution to this very 
problem evidently based upon the principles of partial corre- 
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lation where possible and empirical where necessary, has been 
most successftilly attempted in his scheme just described for 
the selection and classification of S. A. T. C. men. His 
problem was not quite as general as above depicted, for in a 
practical sense it may be assumed that all officerships of the 
same rank are of equal importance, i. e. it is just as serious 
from the standpoint of army efficiency to have an inefficient 
lieutenant in the infantry as in the signal corps. The Com- 
mittee on Education and Special Training of the War Depart- 
ment has a few copies of the scheme, as it was revised by a 
Committee of Supervisors of Personnel Methods and as 
altered in certain details by the administrative officers of the 
Committee on Education and Special Training, which can be 
obtained by those interested. In the form presented it is 
probably slightly less sound theoretically than as left by Dr. 
Thomdike, tho simpler in administration. The capitulation 
of Germany prevented this scheme from being put into gen- 
eral operation. It was however tried out in two institutions 
with very satisfactory results. 
To summarize the salient features — it involves: 

1. A method of elimination from consideration of such 
men as are not fit for any officer post. 

2. A rating of men with respect to possession of certain 
traits — ^traits which promise to be important when judged by 
the criteria previously mentioned. 

3. A rating of officer jobs in the different branches of the 
army with respect to the needs of the branches for men pos- 
sessing the given traits. 

4. A scheme for utilizing these ratings in allotment ' 
whereby the men would be best placed and the jobs best filled 
considering the total supply of available officer material. The 
aim was to make misplacements a minimum, in fact that 
there should be no misplacement whatever except as inac- 
curacies in the original ratings just mentioned should lead 
to it. 

Items (3) and (4) are original contributions to the problem 
of classification and as I interpret them, are in harmony with 
well established statistical principles for a fitting of talent to 
need. 

The possibility of utilizing such a scheme for peace pur- 
poses in industrial and educational classification is far-reach- 
ing, for every man is better fitted for some one place than any 
other, tho of course this will occasionally be no more honor- 
able than a place in an institution for the feeble-minded. The 
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discovery of this 'best place' for an individual is an obligation 
which is definitely thrust upon the psychologist to solve. 

Part II. The Analysis of Capacity. 

It has been shown in the preceding part that a proper fitting of 
talent to need is only to be accomplished when the job analysis 
and the individual analysis show that there are fitting degrees of 
talents in the individual to meet established needs in the job. 

This part will concern itself with the lines along which job 
analysis on the one hand and individual analysis upon the other 
should proceed. The categories into which the elements in- 
volved in either analysis may be divided, are not so distinct 
as to be invariable, but certain divisions will prove of greater 
utility than others. What these are in detail depends upon 
the task for which selection is to be made. There are, how- 
ever, two fields for which men are selected which are so 
diflFerent as to make it necessary to consider them separately. 
They are selection upon the basis of acquired habits, such for 
example as on the ground of trade skill, and selection upon 
the basis of ability to learn, such as selection for special train- 
ing in trade or other schools. Occasionally selection involves 
both of these bases, but as the criteria for judging of the 
fitness, of tests or methods are different in the two cases, and 
as commonly but one basis is marked in any given problem of 
selection, the two will be considered separately. 

As an illustration of the relative independence of the two 
types of selection in practical work, it may be noted that the 
Army Literacy Test and the Army Trade Tests select upon 
the basis of attainment, while the Army Intelligence Tests, 
the Scott plan for rating officers, the Thomdike plan for the 
selection of groimd and flying school men, and the Thomdike 
plan for the selection of S. A. T. C. officer material, endeavor 
primarily to differentiate upon the basis of ability to learn. 

Before considering these two kinds of selection the value of 
attempting a task analysis at all needs to be supported, for if 
efficiency in a large number of common tasks is altogether 
measured by the degree in which some single function, let us 
call it general intelligence, is present, and if general intelli- 
gence is a single thing a measure of which can be approxi- 
mated in one or more ways, then it is quite superfluous to 
analyze the task, for such analysis could only result in reveal- 
ing different ways in which the single capacity operates. With- 
out becoming involved in theoretic considerations, it may be 
noted that there is a pragmatic acceptance of the single mental 
function theory wherever there is an acceptance of an intelli- 
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gence test, such as the Binet test or the Army Intelligence 
Test, as a means of differentiating between abilities practically 
irrespective of the purposes to be served. Whether a general 
intelligence measure is all sufficient is a question which does 
not need to be left to opinion, for it is merely a statistical 
problem to determine the degree of correlation between a task 
and measures which very evidently are not intelligence meas- 
ures ; or, if in part measures of intelligence, to determine the 
partial correlations involved. 

Measures other than of general intelligence have been^ 
found to correlate with success in a very large number of^ 
lines. That it may be expected that such measures exist for 
all the important activities in life is supported by the very 
partial degree to which general intelligence determines the 
vocation which one selects. To illustrate: In a pamphlet 
entitled Army Mental Tests, distributions in Army Intelligence 
Test scores for men following different vocations are given 
by the Division of Psychology of the Surgeon General's Office. 
These data are presented in the form of a chart giving for 
each vocation the lower quartile, median, and upper quartile 
scores. The median score of 'laborers' is lowest and of 
* engineer officers ' highest. From this chart it is possible to 
closely estimate the spread in the scores for each group and 
for all the groups combined. If the standard deviation of the 
scores for all groups combined, weighted as frequencies in civil 
life warrant, is taken as 1.00 it is found by scaling and simple 
calculation that the standard deviations for the separate voca- 
tions do not vary greatly and are approximately Ji, This 
large standard deviation for the separate vocations, taken in 
conjunction with the fact that the Army Intelligence Test has 
a reliability coefficient of about .97, proves that factors other 
than general intelligence are very largely operative in deter- 
mining selection of a vocation. (In this discussion 'general 
intelligence * is used synonymously with ' Army Intelligence 
Test score.') The mathematical proof of this statement is 
accomplished by securing measures showing the relative im- 
portance of general intelligence and other factors entering 
into selection of a vocation. * 

* As the proof of this statement depends upon certain facts of partial 
correlation, one not acquainted with them may skip the mathematical 
analysis, simply noting the values of the final coefficients of correla- 
tion obtained and ffiven at the end of the paragraph. The following 
formulae, given in Yule, G. Udny — Introduction to the Theory of Sta" 
tistics; KeTley, Truman L. — Educational Guidance; or Kelley, Truman 
L. — Tables to Facilitate the Calculation of Partial Coefficients of Cor^ 
relation and Regression Equations (out of print) ; are utilized : 
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It may help in following the illustration to think of the 
vocations as ranking in the accompanying order, which is that 
given by the Army Intelligence Test scores, altho the true 
ranking would be on the basis of the sum total of abilities, 
interests, wages, geographical positions, etc., etc, which deter- 
mine participation in a vocation : 

Laborers 
Tailors 
Cobblers 
General miners 

Painters 

General blacksmiths 

Bridge carpenters 

Telegraphers 
R. R. clerks 
Filing clerks 

Medical officers 
Army chaplains 
Engineer officers 

Let us designate by a variable, x^, position of any vocation 
in such a true ranking. Let us designate b^ x, intelligence test 
position and by x, position in a composite of aU the other 
factors which determine an individual's selection of a voca- 
tion. Xj is related to x, and x„ using the usual r^^ession 
equation notation as follows: 

1. The regression equation involving three variables: 

Xi=bii.» Xa + bu.t Xi 

2. The standard deviation of the eirors of estimate in the case of 

tUree variables: 



The value of a partial coefficient of correlation: 

Tu — Tiirtl 



ru.«=- 



\/l-i*w \/l-rSt 

dard devia 
lecaseof t 



The standard deviation of the errors of estimate (or of the arrays) 
in the case of two variables: 
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Xi=M[>it.f Xa+bii.t Xt 

'dud since Xt oompriseB all the factors othen than general intelligence 
which affect vocational choice, xi is completely determined when xi and 
Xt are known, L e., a^Uf the standard deviation of the errors of estimate, 
would in that case equal 0. However, 

and this can only equal zero in case rii.i=l. Accordingly, 

ru — ^riirii 

rif .1 = — i"^;;^^^^ ZZmill" '^^ Therefore, 

. \/l— r»„ VI— rS. 

rit— riirjg=Vl^u \/Pi^ 

Since Xt comprises factors other than Xs, Xa and Xt are completely inde- 
pendent, or rst=0, and the last equation becomes, 

rig=\/l^ii 
ru may be determined from the standard deviations reported above, since 



ctm— o-iX/l^u, in which <rt.i=I and <r«=l.(X). 

Solving, ri^s.484, the correlation between general intelligence and vo- 
cational choice. Continuing, 

=.875« 



This is the correlation between the * other factors' and 
vocational choice. As its derivation has shown, it is essen- 
tially a function of Xj and Xj, since x, has only been introduced 
for the sake of the argumeiit and is not a known factor, and 
just as .484 is the coefficient of correlation between intelligence 
and vocational choice, so may .875 be called the coefficient of 
alienation between the same two things. If we designate this 
coefficient by ki^ the simple relationship, k'n + r*ij=l, always 
holds. 

In view of this high correlation betweeti these other factors 
and vocational choice it is eminently worth while to attempt 
to discover what they are, and not rest content with such light 
as measures of general intelligence alone give for vocational 
or educational guidance. A task analysis should throw light 
upon what constitutes this very large field which is not gen- 
eral intelligence but which correlates with vocational selection 
to the extent of .875. 

* If the reliability of the Army Intelligence test, .97, were taken into 
account this figure would be a trifle lower. 
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A 

For the successful pursuit of a trade (a) certain habits arc 
demanded, (b) certain concrete items of information, (c) a 
certain degree of initiative and originality — typically repre- 
sented when a worker is called upon to decide which of his 
trade habits is appropriate in a given new situation, and (d) 
in addition to these elements of ability there must be a certain 
willingness to perform the duties of the trade — in other words 
certain increments of satisfaction must result from their per- 
formance in order to insure perseverance and contentment. 

(a) The measurement of habits is readily accomplished by 
means of performance tests involving the habits in question. 
In a trade test it is not feasible to actually measure each of 
the habits exercised by one proficient in a trade, so a sampling 
of the habits is resorted to. Certain samplings are much 
better than others which require the same amount of time. 
Tliat there may be a sharp differentiation between trade and 
trade, the particular habits sampled should be as typical of 
the specific trade as possible ; as largely dependent upon habit 
and as little dependent upon general common sense as possible ; 
as closely allied to habits not measured but involved in the 
trade as possible; while at the same time they should be as 
unlike the other habits which are measured as possible. Meet- 
ing these conditions will insure that the field of the trade is 
covered and not simply that some small portion is measured 
again and again, and that the test does not measure concrete 
items of information or initiative, each of which can be much 
more expeditiously and accurately measured by verbal or writ- 
ten tests. Of course such considerations as material and time 
available for testing, and ease and accuracy of scoring also 
enter in. If the time available for testing is short satisfactory 
results can not be expected from a performance test, i. e., a 
test aiming to ascertain the efficiency of trade habits. A ver- 
bal or written stimulus is adequate to call forth specific items 
of knowledge, but a habit is ordinarily set off by a situation 
brought about by the worker himself in the performance of a 
routine. It takes skill and much time to involve the worker in 
such situations as will betray the trade habits which it is 
desired to examine. This is particularly true if it is desired to 
measure a number of habits in a single test. As a consequence 
it is not to be expected that a short trade test of an hour's 
duration will correlate as highly with efficiency as a fifteen 
minute oral or written test measuring concrete information; 
and in fact this situation has been repeatedly reported as ex- 
isting in the case of different army trade tests. However this 
changes rather than lessens the importance of the performance 
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test, for, if carefully devised a second hour in a performance 
test can be made to yield almost as much new relevant infor- 
mation about a man's trade skill as the first hour; whereas a 
second fifteen minutes in an oral or written test gives a very 
decidedly decreased return from that of the first fifteen 
minutes. In all probability, given excellent tests in both cases, 
some suchrclation as this holds: 

A 15 minute oral test gives more information as to trade skill than 
a 15 minute performance test. 

A I hour oral test gives more information as to trade skill than a 
I hour performance test 

A 2 hour oral test gives equal information as to trade skill to tiiat 
of a 2 hour performance test. 

A 4 hour oral test gives less information as to trade skill than a 
4 hour performance test. 

That the criteria for judging of the excellence of a trade 
test enumerated in the preceding paragraph are not generally 
accepted by people actually making selections, was forcibly 
brought to the attention of the writer by a civil service exam- 
iner who said that he could tell by the way in which an acety- 
lene welder picked up his torch, his degree of skill. The 
writer, as a witness to just such an examination, listened at- 
tentively to the examiner's definite and assured description 
of the workman's ability, and being both a guest and a novice 
in welding, expressed great interest in the examination though 
mentally noting that several trades involve handling torches; 
that the picking up of a torch is hardly a matter of habit, as 
the location of the work with respect to the torch varies with 
the job ; that the degree of merit shown in the picking up pro- 
cess is entirely a matter of the subjective opinion of the 
examiner; etc., etc. However, to date the case is iii favor of 
. the examiner, for neither he nor the writer has ever been told 
that the man did not have the exact degree of skill attributed 
to him. The man, the examiner, and the writer have, like 
gentlemen, refrained from concerning themselves with each 
other's business. 

This story is typical and not exceptional, for every exam- 
iner, be he a trade tester or a collie professor, who does not 
chedk up on his classification by studying the later perform- 
ance of those clasified, is confirmed in his procedure though 
it contain essentially and easily ascertainable erroneous 
devices. The less the test, in its giving and scoring, (but not 
in its derivation) depends upon the trade expertness of the 
examiner, generally tiie better— certainly the better from the 
standpoint of objectivity and uniformity or reliability of 
meastu^ment. 
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(b) The measurement of specific items of information 
which are pertinent to a trade can be accomplished by means 
of an oral or written questionnaire, or by other means such as 
appropriate picture completion tests. Certain important diffi- 
culties may be mentioned : One is due to the fact that trade 
terms are very fluent — the word "plug" probably means a 
score of specific things in as many trades, and probably also 
no single one of these twenty " plugs " is universably known 
by that name. Another difficulty is due to the fact that for- 
eigners hav^ a different nomenclature — one which is not a 
literal translation of the English. Another is due to the diflfer- 
ence in procedure in different parts of the country — carpen- 
ters trained in New York, Georgia, and California will answer 
the question " What is done first in building a house " in very 
different ways and each in a way which is right according to 
his training. Another is due to the ease with which people 
can be coached upon items of specific information — an indi- 
vidual with the barest trace of literacy can be taught to cor- 
rectly answer the following written questions: "What is 
your name? " " In what country were you bom? " " In what 
State in the Union is your domicile ? " " Has your abode been 
restricted to the confines of the aforementioned habitat for a 
decennium ? " Coaching is nearly as easy in other specific in- 
formation tests. Questionnaires based upon pictures and 
involving few words (extensively used in the Army Trade 
Tests), picture completion tests, and picture matching tests 
seem to be as little subject to the diffculties mentioned as any. 

(c) The measurement of such initiative and originality as 
is needed in a trade may be approached in a number of ways, 
all more or less similar to the usual means of measuring gen- 
eral intelligence. A specific variation from this which prom- 
ises to yield exceptional return, is that of making trade 
material and procedure the content of the test rather than the 
usual general intelligence material which is considered to be 
common to the experience of Americans. Reasoning tests 
involving engineering material were used by Thomdike in 
his study of Engineering ability, (conducted for the Carnegie 
Foundation for the Advancement of Teaching, report of which 
is published by the Foundation) with very satisfactory results. 

(d) There is little reason to believe that the measurement 
of interest should prove a serious obstacle in the case of trade 
testinjg, for it should be possible to ascertain by means of a 
questionnaire the degree of satisfaction which in the past has 
resulted from the practice of the trade. The amount of satis- 
faction found in the work in the past and the opportunity the 
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trade gives for realizing present aspirations provide a prog- 
nosis for the future. 

Turning from the measurement of an acquired facility to 
react, to 3ie measurement of facility to learn to react, a radi- 
cally different situation is presented. The measurement of 
concrete items of information is of no value in itself, and 
only becomes diagnostic of ability to learn in so far as it 
reveals a necesary foundation for the learning process, and in 
so far as the learning of concrete items in the past correlates 
with the ability to learn new concrete items in the future. 
The measurement of habits holds a similar position. Abilities 
(a) and (b) are of less, and abilities (c) and (d) of greater 
significance, than before, but the measurement of ability to 
learn is so different from the measurement of attainment that 
an entirely different division into elements is called for. 

The measurement of ability to learn may properly be divided \ 
into: (a) The measurement of prerequisites, ground work, 
or necessary foundations upon which to build; (b) The meas- 
urement of accomplishment in itself not essential but which 
has been attained as a result of an activity which correlates 
highly with the activity necessary in learning the task in hand, 
e. g. if there is a high degree of correlation between the ease 
with which an American can learn French and the ease with 
which he can learn Chinese, a measurement of the time spent 
in learning French and facility acquired would give evidence 
as to the probable success in learning Chinese; (c) the meas- 
urement of ability to learn the new task by tests which are as 
nearly as possible samples of operations demanded in the 
task itself; and (d) the measurement of interest. -^ 

(a) The utility of a measurement of prerequisites must be v 
considered in connection with the question of transfer of train- 
ing. It has been thoroughly demonstrated in the training of 
mechanicians and engineering officers in the army that a great 
many of the foundations assumed in peace times to be neces- 
sary for proper training are unessential. The writer has seen 
commissioned and non-commissioned officers taught the theory 
of the internal mechanism and of the explosive charge of the 
hand grenade, on the assumption that these were necessary to 
the proper manipulation of the grenade in warfare. Other 
army experience has shown the futility of this. Though the 
case cited is more extreme than ordinarily found, it is to be 
expected that the same sort of absurdity maintains in every 
field in which extreme press of circumstances has not led to 
the ascertainment of what constitutes the real essentials. This 
condition has a parallel in the measurement-of-fitness field, 
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for there is a very large amount of examining which, in so far 
as it results in reliable measures, yields measures of traits 
which are not essential to the task examined for. 

The question as to the essential or non-essential nature of a 
foundation is to be answered by partial correlation, i. e. by 
calculating the extent to which excellence in this ground work, 
other things being eqtuil, is evidence of fitness in the task. 
Simple correlation of excellence in the groimd work with suc- 
cess in the task is not evidence that the foundation chosen is 
a true prerequisite for the task, or even that knowledge of the 
foundation is evidence of probable fitness in the task, if other 
measures of fitness are to be used at the same time. In spite 
of these objections, the difficulty of securing under ordinary 
test conditions true samplings of a new task, and the relative 
ease of securing measures of success in past attainment, war- 
rant the expectation that this method, if very judiciously 
used, will yield valuable information. 

(b) The precautions consequent to the limited degfree in 
which training transfers, mentioned above in connection with 
utilizing knowledge of prerequisites, are equally necessary in 
utilizing measures of attainment in tasks not a part of the task 
under investigation, but supposed to be dependent upon the 
same sort of mental capacity as is this task in question. 

(c) There is no doubt that the ability to expeditiously learn 
to do a sample of a task, correlates very highly with the ability 
to learn to do a lot of such samples — i. e. the task itself, should 
it be entirely composed of such samples. The individual who 
can quickly memorize the connection between "house" and 
"domus" will be adept in memorizing one thousand such. 
Surely no prognosis of ability can be better founded than that 
based upon performance in a thorough sampling of the task; 
but ability alone does not determine fitness, for fitness is in- 
dissolubly connected with interest. 

(d) An individual who takes interest in a test involving 
memorizing ten foreign words and stands high in it may be 
very averse to memorizing five thousand such and even still 
more averse to regularly practicing such an ability in trans- 
lating the literature of a foreign language. Interest in learning 
under test conditions ; interest in learning under school or ap- 
prenticeship conditions ; and interest in the repeated and routine 
exercise of the association formed under ordinary vocational 
conditions, are distinct things which cannot be expected to 
correlate to a high degree. As an actual illustration, the case 
may be cited of a young man who in three months learned a 
trade, ordinarily accomplished thru a four years' apprentice- 
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ship. He practiced the trade as a journeyman for two months 
and then left to take up work giving opportunity for training 
in a profession rather less remunerative than the trade, showing 
that in spite of interest and ability in the learning process, there 
was little interest in the routine exercise of the thing learned. 

It may be roughly true that the greater the ability to learn 
the greater the interest in learning, but this does not imply the 
greater the interest in repetition after learning. Initiative and 
originality lead to satisfaction in the learning process, but to 
annoyance in the routine repetitive process. From the stand- 
point of interest there must be a happy degree of initiative and 
originality for each vocation — ^just enough to lead to such sat- 
isfaction in the learning of the vocation as to carry the indi- 
vidual through the difficulties of learning but not so much as to 
make the annoyance of routine performance unbearable. 

The preceding paragraph has considered interest as related 
to ability, for initiative and originality are largely intellectual 
factors capable of measurement. There are also interests 
definitely related to other abilities, such as interest in music, 
painting, etc., etc. Interests other than those dependent upon 
ability presumably exist and of course influence readiness to 
learn and to follow a given line of work. Their direct meas- 
urement seems almost impossible but in so far as they are con- 
stant and will operate in the future as they have in the past, 
their influence can be approximated by ascertaining the degrees 
of satisfaction which have accompanied learning and routine 
occupations of various kinds in the past. 

In recalling the traits needed for the successful performance 
of a trade and those needed for the successful learning of a 
new task it will be noted that general intelligence is only ap- 
proximately synonymous with initiative and originality in 
selecting appropriate trade habits, and with ability to learn new 
tasks. The other factors may be expected to be in part, pos- 
sibly in large part, those which correlate so highly (.875), with 
vocational selection. 
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THE PRACTICAL " EFFICIENCY " OF A GROUP 
SCALE OF INTELLIGENCE 

STUDIES FROM THE PSYCHOLOGICAL LABORATORY OF 
INDIANA UNIVERSITY 



By S. L. Pressey and L. W. Pressey 



I. The Standardisation 'of Tests of Intelligence in Terms of 

Their Uses, 

In the September number of the Journal of Applied 
Psychology the writers described a group scale of intelligence 
for the measurement of the native endowment of school chil- 
dren. The scale has thus far been employed for two purposes 
(1) to aid in a census of the feeble-minded children in the 
schools of a certain Indiana county — this as part of a " men- 
tal survey " to determine the number of children needing in- 
stitutional care in the county — and (2) as an aid in sorting 
children, according to ability, in the public schools. The 
present paper aims to present some facts relative to the effi- 
ciency of the scale as a whole, and of its separate parts, for 
these two purposes. 

It should be pointed out at once that such a method of 
evaluating tests of general intelligence — obvious as it is — is 
somewhat unusual. The Binet and Point Scales have made us 
familiar with methods of estimating, more or less directly, 
mental ability in terms of amounts of development. The 
scales have been standardized by determining the average per- 
formance of children of different ages. And the value of a 
given test has commonly been estimated by the extent to which 
it distinguishes the average child of one age from the average 
child of another age. 

Tests may also be evaluated by correlation with the results 
from a large group of other tests of high differential value. 
Standardization in terms of mental development is, if we may 
trust recent experimentation,* not wholly relevant to the 
problem. Tests which are differential of chronological age 

1 Brigham, Carl C. Two Studies in Mental Tests. Psychol. Mono- 
graphs, Vol. 24, 1917, No. I, p. 245. Doll, E. A. A Brief Binet Simon 
Scale. Psychol, Clinic, Vol. 11, 1917, pp. 197-21 1 and 254-62; also 
Pressey, S. L. and Cole, L. W. Are the Present Psychological Scales 
Reliable for the Use with Adults? /. of Abn. Psychol,, Dec. 1918. 
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are not necessarily the tests which are differential of degrees 
of mental ability at a given age. And evaluation of a test, by 
correlation with the results from a group of other tests, results 
in an " inbreeding " which may have the advantages, but cer- 
tainly has also the dangers, incident to in breeding in the 
biological field. Doubtless a more refined mathematical hand- 
ling may avoid such a danger, and give us our final method 
for evaluating tests of " general intelligence." But meanwhile 
it is interesting to see whether it may not be possible, by simple 
and more direct methods, to obtain some indication of the 
efficiency with which such tests serve two of the many pur- 
poses for which such scales are ordinarily employed. 

The present paper will take up in order three questions. 
First, what is the efficiency of the group scale used, as a whole, 
in separating out from a total school population (a) feeble- 
minded of institutional grade, and (b) those children who are 
sufficiently subnormal or brilliant to deserve special educa- 
tional treatment? Secondly, what is the contribution of each 
test in the scale to these differentiations ? Finally, what is the 
efficiency of certain of the most differential of these tests, 
when grouped into a brief scale, for the purposes above men- 
tioned, as compared with the whole scale? 

The scale was first used as a means of first selection of 
cases, in a mental survey made to determine the number of 
mental defectives, needing institutional care, in a certain 
Indiana county. In order to find out what ratings, on the 
scale, ought to be considered suggestive of such mental defect, 
the simple expedient was adopted of surveying with the scale, 
the state school for the feeble-minded. The scale was, how- 
ever, planned chiefly as an aid in discovering those school 
children who, because of exceptional dullness or exceptional 
brilliancy deserve special educational treatment. In order to 
determine how well the scale performed this service a special 
class for gifted children and a special class for subnormal 
children in Louisville, Kentucky, were examined, and retarded 
and accelerated children in the Bloomington, Indiana schools 
were compared — these two groups being taken to best repre- 
sent, in a system not having special classes, the school's judg- 
ment as to those capable of superior work or not capable of 
doing the work of tiie average child.* A rough measure has 

^6S was taken as normal for the first grade, and so on up. With 
this standard, retardation and acceleration are phenomena sufficiently 
abnormal to have a definite significance as indicative of a child's mental 
capacity. Age at time of examination was used, this being considered 
satisfactory for the purpose in hand. 
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been obtained of the completeness with which the scale sets 
these special groups apart from the group of average children. 
The study is based on results from 986 Bloomington, 
Indiana, school children, 200 cases at the state ** School for 
Feeble-minded Youth," 23 children in a class for gifted chil- 
dren, and 25 in a class for subnormal children at Louisville. 
Data from two other cities surveyed (a total of nearly 2,800 
cases) will also be referred to.* 

II. The Differential Value of the Scale as a Whole. 

Let us first examine the efficiency of the scale as a means 
of first selection, in the public schools, of cases sufficiently 
defective to need institutional care. The relation of the scores 
obtained at the state " School for Feeble-minded Youth " to 
the total distributions of scores for the Bloomington children 
may be indicated very briefly. 

All cases in the institution, with the exception of a few adult 
" boys " living on a branch farm, who were sufficiently literate 
to take the examination (that is, all cases who had advanced 
beyond the second grade) were tested.* Of the total 416 
cases in the institution 11-18 years old, only three made a rat- 
ing above the lowest ten percentile for the school children of 
the same age. One of these three has a Stanford-Binet 
I. Q. of. 78, for the others no ratings are available. One 
is eleven, the other two are brothers aged twelve. All three 
are orphan asylum children; the best children come, they say 
at the school, from the orphanages. There are only five cases 
rating above the five percentile for the school children. Of 
the thousand odd cases over eighteen, again three rate above 
the ten percentile for sixteen. One of these has an I. Q. of 81, 
another of 85. All three are delinquent girls. 

Such results seem to be evidence of some definiteness that 
the scale measures general intelligence, if we define general 
intelligence as an intellectual quality lack of which, to any 
considerable degree, requires that the individual concerned be 
placed in an institution, and possession of which enables the 

• The writers wish to acknowledge their obligation to Dr. George 
W. Bliss, Superintendent of the Fort Wayne " School for Feebleminded 
Youth," to Miss Henrietta V. Race, school psychologist in Louisville, 
and to the school officials and teachers of the systems studied, for the 
opportunity to obtain these data, and for their help and interest in the 
work. 

^ It should be added that all doubtful cases were also given the 
examination, and that some fifteen papers were thrown out, the 
examinations showing little that could be considered other than chance 
successes. 
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individual to continue in the environment. The scale distin- 
guishes quite definitely these two groups. It should be 
said that the particular institution surveyed possesses a smaller 
number of young high-grade defectives than certain eastern 
institutions with which the writers are familiar. It 
may very well be that a survey of one of these schools 
would show the scale much less clear-cut in its differentiations 
than it appears at present. But the scale was not being used 
to help in an enumeration of cases which were to be put in an 
institution in New York or Massachusetts. It was being used 
to determine how many cases, in the schools of a particular 
county in Indiana, were mental defectives of institution type, 
as that type was defined in this particular state. The state- 
ment that a certain Bloomington school girl sixteen years old 
scored lower than 33 of the 69 girls of her age already in the 
institution and that she made a total score of 15 where cases 
in the institution ran up scores as high as 110, surely goes 
straight to the point in terms no one can misunderstand. * It 
should be added that this particular survey was part of a lar- 
ger study undertaken by the State Board of Charities in an 
effort to demonstrate the pressing need of further provision 
for the care of mental defectives. To carry conviction to 
people not familiar with the significance of findings on the 
Binet Scale, the statement just given is more effective than 
any statement of I. Q. or even of mental age might be. It 
surely means more to the average individual than to say 
merely that this girl makes the lowest score of any school 
child of her age in her town. It means more than the state- 
ment that she grades lowest of 268 unselected school children 
in the three towns surveyed. The direct comparison with the 
group at Fort Wayne has a most immediate practical sig- 
nificance which cannot be escaped. 

A special class for gifted children at Louisville, Ky., had at 
the time the writers visited it, 23 members, eight to ten years 
of age. Their I. Q.s on the Stanford Binet scale ranged from 
1.23 to 1.69. But more important for the purpose of evalua- 
tion of the scale, in the immediately practical ways which have 
been attempted, is the fact that all these children had been 
for a year or more in this special class, doing roughly two 
years work in one, and had proven their capacity for such 
work. These children make on the group-scale scores which 
fall in the highest ten percentile for Bloomington, with 

> This girl has a mental age of six, an I. Q. of 42. She is in the 
fifth grade because only in this room are the seats large enough for 
her. 
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three exceptions; these three are only slightly below the ten 
percentile. They are the three who have the lowest mental 
ages/ 

In the special class for subnormal children at Louisville 
three out of twenty-five make scores above the ten percentile 
for their age. As the class contained moral delinquents as 
well as merely dull children, this is not surprising. 

It would appear then, from these Louisville data, that the 
scale was of some efficiency in separating children who have 
already been especially diagnosed by the school as sub- 
normal or brilliant, from a group of average children. 
The differentiation is not as clear-cut as might be wished. 
But, taking the groups as wholes, it would seem fair to infer 
that the scale does primarily measure that sort of ability, 
possession of which, to a marked degree, makes a child capable 
of exceptional school work, and lack of which necessitates 
special educational treatment. The brilliant class averages 
at the 98 percentile for the total Bloomington group ; the sub- 
normal group at the 4 percentile. 

It seemed probable that there would be similar groups of 
dull and gifted children among the Bloomington school chil- 
dren. But since there were no special classes the writers had 
to rely on the less certain phenomena of acceleration and 
retardation as a definite pedagogical expression, in such a 
system, for subnormality and brilliancy. It was the intention 
of the writers to consider only such pupils as were sufficiently 
retarded or accelerated to represent distinct deviations from 
the average in mental ability. Only those children acceleratied or 
retarded a year or more (by the standard already mentioned) 
were therefore studied: When the scores were tabulated, the 
simple expedient was adopted of marking these retards into the 
score sheets with blue ink, the accelerates with red ink, while 
the other children were checked in with pencil. A picture of 
the relation of retardation and acceleration to group-test score 
was thus obtained, with practically no work beyond what 
might have been involved in a straight tabulation of the 
distributions. 

It is self-evident that, since the examination was not given 
below the third grade nor beyond high school, there were no 
8, 9, and 10-year-old retards (since these would be in the 
first and second grades) and no accelerates above fifteen 
(since these would be through high school). It was finally 
decided to consider only the retards from 11 through 15 and 

* It might be added that the product-moments corellation of mental 
age with group-test score is .63 for this class. 
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accelerates from 10 through 14, because for these ages only 
was there sufficient opportunity for acceleration and retarda- 
tion to show itself. Among the 579 cases in these five ages 
there were 32 cases retarded over a year, of whom 23 are in 
the lowest ten per cent for their ages on the total distribution. 
And there are, in a total of 571 cases, 47 accelerates of whom 
18 are in the highest ten per cent. 

It is natural that the scale should select more accurately for 
retards than for accelerates, since a bright child may very well 
do poorer work in the tests because of chance circumstances 
of the day or the examination, but a dull child is much less 
likely, as a result of fortuitous circumstances, to excell himself. 
The differentiation of neither group is as clear-cut as might 
perhaps be wished. But from another standpoint the interest 
of the situation is just here, and the value of such a method of 
dealing with results is particularly great. To take an actual case 
— the boy who makes the best score, of the 133 fourteen-year- 
olds tested, is in the grade normal for his age. His parents 
wish him to go to work as soon as the law permits, and the 
boy himself has lost all interest in his schooling. It is surely 
of no little help in dealing with the situation, to be able to 
point out that the boy shows ability on the tests above that of 
children of his own age who are two or three grades ahead of 
him in school, that he rates above the average for the senior 
year in high school and yet is idling away his time in the eight 
grade. In short, there is direct evidence to show that if he 
would arouse himself to the value of his school work and 
continue farther in his studies his efforts would undoubtedly 
be successfirf and his progress rapid. The highest score, 
among the eight year children, was made by a boy in the third 
grade. In urging that he be advanced (as his teacher admits 
he should be) it is surely an aid in the argument to be able to 
show that the child makes exactly the same score as another 
eight-year old boy in Louisville, who is now in the fourth 
grade and successfully doing two years work in one, and that 
in his own school there are eight-year-old children one and 
two grades ahead of him, who make poorer ratings than he. 
He rated, in fact, above the average child in the fifth grade. 

So much for the evaluation of the total scale for the two 
purposes above mentioned, for separating out feeble-minded 
cases of institutional grade from the total school population, 
and for marking off extremes of ability in that popula- 
tion. Some evaluation of the individual tests of the scale re- 
mains to be made. As was stated in the previous article 
already referred to, the tests used in the scale were selected 
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with some care on the basis of their ability to differentiate 
dgrees of ability — ability being estimated on the basis of Binet 
examinations, teachers' rankings, school records and other 
similar data. But these estimates were made on a relatively 
small amotmt of data, and it seemed interesting to make a new 
evaluation. Such an evaluation was also called for by certain 
important failings that had already appeared in the total 
scale. The scale took three-quarters of an hour to an hour to 
give. This is too long for ordinary school work; provided a 
' sufficient reliability can be obtained, such an examination 
should not take over thirty minutes, the average school period. 
An elimination of some tests was thus suggested. Certain 
tests had already proven relatively unsatisfactory, so far as 
ease and standardization in giving and ready scoring were con- 
cerned. However, if the scale were to be cut down by the 
elimination of certain tests, the question as to which tests 
should be eliminated ought to be settled primarily by a meas- 
ure of the comparative differential value of the separate tests. 
The method adopted for doing this, and the results, may be 
indicated very briefly. 

III. The Comparative Differential Value of the Separate 
Tests of the Scale 

A rough indication of the contribution of each test to the 
differentiations above mentioned was obtained in the process 
of working out norms by test. The scores on each test, at 
each age, were tabulated for the total Bloomington group. 
This was very readily done, since each test has* twenty items 
and the tests were graded, in the first place, roughly, so that at 
each age about the same score would be made by the average 
child on each test. A separate sheet of cross-hatch paper was 
used for each age. The possible scores (1-20) were numbered 
across the top ; the tests from 1 to 10 down the left hand side. 
If a nine-year-old child made scores on the ten tests of 9, 10, 
9, 8, 6, 9, 4, 3, 8, 5 respectively, his scores were recorded by 
making a mark at 9 in the space allowed for the first test on 
the nine-year chart, a mark at ten in the space allowed for 
the second test, etc. But before tabulating a given age the 
papers were arranged in order of total score for that age; 
the records of those scoring in the lowest 10 per cent were 
then tabulated by test — in black ink. The records of the 
middle 80 per cent were tabulated in pencil; and finally the 
scores of the highest 10 per cent were recorded in red ink. 
This gave on the tables a rough picture of the agreement of 
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each test with the results by total score in separating off the 
highest and lowest 10 per cents of the distribution at each 
age. If test 1 were completely differential of the lowest 10 
per cent of mental ability, as defined by the total scale, then 
the black marks would all appear at the bottom of the distri- 
butions for test one, below the lowest pencil mark. Such 
a test would be 100 per cent differential, or there would be 
per cent of error. If some of the black marks appeared 
above some of the pencil marks the test would be less than 
100 per cent differential or there would be a per cent of error. 
If, for instance, on test one at year nine a black mark appears 
above eight pencil marks, we may say that on this particular 
case the first test was eight cases in error. And the average 
of all such errors, on each test, expressed as a per cent of 
error, will give a ready means of measuring roughly the cor- 
relation of each test with the total score at the extremes of 
the distribution.^ The average per cent of error of each test, 
for ages eight through sixteen combined, for the 986 Bloom- 
ington school children, runs as follows: 

Test 123456789 10 

LowestlO.% 17 7 11 7 11 8 8 6 11 7 

Highest 10% 13 8 11 8 17 12 7 10 12 7 

Total Error 30 15 22 15 28 20 15 16 23 14 

The first point to notice is that the tests which are most 
differential of subnormality are those also most differential 
of brilliancy. With one exception, the four tests most differ- 
ential of the one group are most differential of the other, and, 
again with one exception, the least differential tests are the 
same. The two errors have, therefore, been combined to make 
a total error in differentiating the extremes. The two least 
valuable tests appear to be the first and the fifth. The first is 
a test of rote memory (the children are read lists of words 
such as "chalk, man, bag, book, sister " and then asked to write 
the word that came after " chalk ") ; the fifth is a test of 
logical memory (the class is read a newspaper passage and 
then asked questions about it). The most differential test is 
the tenth, next come the second, fourth and seventh. The 
tenth test is "Analogies," the fourth "Opposites." The second 
is "Logical Selection" (the test contains such lists as "CHAIR 
— arm, cushion, legs, rockers, seat" and the children are told 
to " underline the two things, in each list, that the thing named 

'As may readily be seen, the caluclation of the error can be made 
extremely simple and rapid; the whole method is much more compli- 
cated in the description than in practice. 
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in big letters at the beginning of the list is never without."). 
The seventh test is " Moral Classification." (The test consists 
of a list of twenty words, beginning " whispering, setaling, 
charity, drunkenness," and the children are told to "put a * 1 ' 
under words meaning something you mustn't do in school, a * 2' 
imder words meaning being good to other people, a * 3 ' under 
words meaning something that is bad for yourself, and a * 4 ' 
imder words that mean getting things from other people in 
ways you shouldn't.") The fifth most differential test is the 
eighth, " Dissected Sentences." 

It was decided to make a brief scale out of these five most 
diflFerential tests. It was found on closer study, however, that 
the seventh test was differential only with the older children ; 
the test permitted sufficient chance successes to blurr the re- 
sults with the young children. The next test in value, the 
sixth, was therefore substituted ("Word Completion" — ^the 
children are told to fill in the missing leters in such words as 
"a .it .me .ic"). The other four tests excluded from the 
brief scale were the " Practical Arithmetic " test (the children 
were read such problems as " If you had 25 cents, and bought 
two erasers at 3 cents each and a bottle of ink at 5 cents, how 
much would you have left?"), and the ninth test (" Practical 
Information " — the test contains such lists as " bill, coins, 
check, draft, stamps," the children being asked to " put a line 
under the safest way to send money, and a cross after the 
least safe way"), and the two memory tests already referred 
to. It should be said that the above findings with regard to 
differential value were not the only factors in bringing about 
the exclusion of these tests. The arithmetic test was too long, 
and it made too many demands upon the skill of the examiner, 
to be easily kept constant from one examiner to another. This 
fault also held for the two memory tests ; besides, they called 
for writing, and so required more time in the giving and were 
harder to score. The five tests finally included in the " half 
scale " were thus not only the most differential, but the best 
constructed tests as well; both criteria were used in making 
up the new group. 

IV. The Differential Value of the "Half Scale" 
The half scale was, then, made up of the following tests: 
" Logical Selection," " Opposites," " Word Completion," "Dis- 
sected Sentences," "Analogies." These are, it happens, the 
even numbered tests of the whole scale. It was now a very 
easy matter to add up the scores on these five tests, on the 
records from the full scale, and tabulate the distribution of 



Digitized by 



Google 



••efficiency" of a group scale of intelligence 77 

half scale scores, as we might expect those results to fall if 
these tests had been given separately, as a short scale.' 

The question will he asked, whether the full scale did or 
did not emphasize, in its sampling of mental functions, some 
rather special trait, and whether a half scale made of the 
tests correlating most closely with the scale as a whole may 
not be merely a scale testing more specifically this one trait? 
That is, has there not been a harmful "inbreeding"? To 
obtain some light on this question, the writers have simply 
evaluated the half scale in terms of its efficiency for the two 
practical purposes already mentioned, in exactly the same 
fashion as was done with the full scale. 

TABLE I. 
Half Scale: Results from 1022 School Children in Bloomington 
Age No. 10% M. 90% Grade No. 10% M. 90% 

8 53 15.3 31.5 44.8 3 116 9.9 27.6 42.8 

9 92 15.5 33.2 55.0 4 99 16.4 33.3 48.0 

10 96 20.8 46.5 66.8 5 96 33.6 50.1 62.9 

11 114 23.5 55.9 74.9 6 108 46.4 58.9 70.9 

12 117 41.9 59.5 77.7 7 123 50.4 65.5 76.7 

13 111 47.7 65.4 78.0 8 122 59.5 69.6 81.3 

14 133 51.6 70.4 85.3 I 123 63.0 76.5 86.9 

15 104 55.7 76.2 88.0 II 97 70.0 80.4 88.5 

16 89 66.0 79.9 89.6 III 82 71.1 81.0 91.9 

17 80 68.5 81.0 90.0 IV 56 77.4 84.5 90.3 

^ 1022 

The results can be given in a paragraph. When the scores 
on the half scale were worked out for all the cases already 
mentioned, it appeared that for the first purpose mentioned, 
for selecting out feeble-minded of institutional grade, the two 
scales gave largely similar results; both scales show three 
Fort Wayne cases eighteen years or under rating above the 
10 percentiles for the Bloomington school children, five rating 
above the Bloomington five percentiles. But for the second 
purpose, for aid in determining those children so subnormal 
or so brilliant mentally as to deserve special educational treat- 
ment, the half scale would appear to be, if anything, superior. 
The whole scale shows 20 of the 23 in the gifted class at 
Louisville in the upper ten per cent of the Bloomington group ; 

8 We do not know, of course, that these tests would behave in the 
same way by themselves as when given together with the other tests. 
But norms thus derived may surely be expected to approximate with 
fair closeness the results which would have been obtained if the five 
tests had been given alone at least with a closeness sufficient for the 
purposes of the present paper. The norms thus derived are given in 
table I. 
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the half scale places 21 there. The full scale shows 22 of 
the 25 in the Louisville class for subnormals, the half scale 23, 
in the Bloomington lower ten per cent. The whole scale 
places 23 of the 32 Bloomington retards in the lower ten per 
cent for their age, the half scale puts 26 there ; by the whole 
scale 18 of the 47 accelerates are above the ninety percentiles, 
28 between ninety percentile and median, 1 below the median, 
by the half scale 31 are in the upper ten per cent, 16 between 
ninety percentile and median, none below the median.' 

V. Discussion 

It would seem, then, that for most purposes these five tests 
would be quite as efficient as the full ten of the earlier scale. 
They are suggested as a very convenient group for rapid sur- 
veys of schools or school systems. The tests take about 
twenty-five minutes to give, can be printed (or mimeographed) 
on two sides of a single sheet of typewriter paper, and are 
readily scored. The norms given above may be thought of as 
fairly accurate. The half scale may very likely not give so 
stable a measure, in individual cases, as the full scale; and it 
gives data much less interesting for research purposes. How- 
ever, for many practical uses the five tests should prove much 
more satisfactory. 

But the writers have been much more interested in certain 
general principles involved in the present study, than in any 
particular results which might be obtained. We very much 
need more intimate knowledge as to just how important the 
qualities tested by our tests of " general intelligence " are, in 
the total complex of qualities that determines social in- 
adequacy and irresponsibility. The institution surveyed con- 
tained a much smaller proportion of " Problem cases " than is 
found in many such institutions, at least so it seemed to the 
writers. But for all that, the " children " at Fort Wayne were 
a very heterogeneous group, who required institutional care 
for a variety of reasons. The writers believe that a system- 
atic study, beginning with a survey by means of group tests, 
of the total population of such an institution, would yield 
results of unusual psychological — ^and sociological — ^interest. 
Until such studies have been made we cannot know all that we 
should about the meaning of our test findings, when we are 
using our tests to aid in diagnosing " feeble-mindedness." 

• Expressed in terms of the " average error " above referred to, the 
whole scale shows 5% of error, the half scale 0.9%, in differentiatixig the 
gifted class; errors are 5% and 3% in differentiating the subnomuil 
class. And they are 6% as compared with 3%, and 5% as com- 
pared with 2% in differentiating retards and acceelerates respcctivd^. 
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The checking up of our tests by study of groups of excep- 
tional school children who have been independently selected 
is also worth while. Such methods of evaluation involve 
errors of their own, which cannot be discussed here ; the Fort 
Wayne cases may have been " institutionalized," and the 
special school groups given a special training, to an extent 
which may have affected the results. But at least a rough 
indication has been, in the present instance, obtained of the 
significance of findings on the scale used, in terms of social 
inadequacy and of markedly superior and inferior educability. 
The results have not, perhaps, been altogether satisfactory so 
far as the merits of the tests are concerned. But at least (as 
the writers have especially tried to show) so far as the meas- 
ures are reliable they have a much more direct practical impli- 
cation than would otherwise be the case and it must always be 
bom in mind that special groups may not be, by any means as 
well selected as they should be ; it would certainly be quite as 
interesting to discover in a special class or an institution for 
the feeble-minded, a case which did not belong there, as to 
find among average individuals an abnormal case. 

The present study has thus involved a special effort to relate 
the test findings closely to the practical problems in connection 
with which they were to be used. The writers cannot escape 
the feeling that mental measurement has been too much 
dominated by the concept of " general intelligence " — ^that 
the varied educational and sociological problems dealt with 
in such work are much more complex than is sometimes 
realized, and that special methods are in most instances needed 
for each problem.*® A more intimate contact with the total 
situation in each special field seems necessary. The writers 
hope shortly to present data from a number of such special 
groups (including three institutions for the feeble-minded) 
with analysis by test of the differential findings. 

Summary 

1. The " Group Point Scale " distinguishes the children in a 
state institution for the feeble-minded from a large group of 

1® There was some evidence in the present study to show that the 
tests most satisfactory in marking off the extremes of educability 
among school children were not the best for diagnosis of that type of 
subnormal mentality which requires institutional care. That is, the 
two tests most differential of the Fort Wayne group were only seventh 
and ninth in differentiation of the backward school children; the two 
tests best separating out this grroup were fifth and poorest in diagnosis 
of the institutional cases. 
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school children with only a slight overlapping, in the lower 
ten per cent of the distribution for the school population. 

2. The scale places 42 out of 48 children in a class for bril- 
liant and a class for subnormal children, in the two extreme 
ten per cents of the total distribution for the school children. 

3. It separates nearly as accurately extreme retards and 
markedly accelerated children from the average group. 

4. There is some evidence to show that a scale made of the 
five tests most differential among the ten used, would be slightly 
more differential of the groups above mentioned than the 
entire ten tests. 
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THE FIELD OF CLINICAL PSYCHOLOGY AS AN 
APPLIED SCIENCE 

A SYMPOSIUM 

(The three following papers were prepared for a symposium 
which was to be presented at the annual meeting of the newly 
organized American Association of Clinical Psychologists, held 
in Baltimore, December 28. Owing to the lateness of the hour 
it was necessary to omit the reading of the papers. Following 
the suggestion of several members, the papers are published 
here, without alteration, in order that the material may be made 
available to the members before the next meeting. J. E. W. W.) 

Arnold Gesell, Ph. D., M. D., Yale University 

The purpose of this symposium is to direct discussion. It is 
hardly necessary to simply provoke, discussion. We are dealing 
with a very unsettled subject ; artd it is rather too easy to call 
forth difference of opinion. Two considerations, however, are 
no longer in the arena of debate ; first, that there is a specialty 
entitled to the name of clinical psychology ; and secondly, that 
there should now be some form of organization to protect and 
to promote that specialty as a profession. 

When, however, we bluntly raise the question, "What is 
clinical psychology?" consensus of opinion by no means pre- 
vails. Some persons object to the term altogether, and prefer 
such designations as consulting psychology and applied psy- 
chology. Both of these substitute terms, however, are more 
general and less descriptive. Specifically, clinical psychology 
is the science and art of individual mental examination and 
interpretation. It is rather more an art than a science, because 
its objective is the determination of the mental status of a sub- 
ject, and the deduction of a practical conclusion as to the possi- 
bilities and limits of his improvement. A clinical psychologist 
is one who is qualified to make a responsible, interpretive mental 
diagnosis. 

Clinical psychology is to be distinguished from psycho- 
technology. Psycho-technological work has to deal with special 
and more or less technical questions of methodology and pro- 
cedure in the fields of industry, commerce, advertising, sales- 
manship and school administration. Educational psychology, 
the mental survey, group testing and even trade testing have 
more afiinities with psycho-technology than with clinical psy- 
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chology. The latter has to do with diagnostic individual 
examination. 

In actusd practice the field of clinical psychology has usually 
not attempted to include individuals suffering from definite 
mental disease. There are sound reasons for this. There are 
many problems common to psychiatry and to clinical psy- 
chology, but there is also a cleavage which must be respected. 
There is a considerable field of psycho-pathology which legally, 
traditionally, administratively, and even theoretically is in- 
timately part of the science and art of medicine. Psychiatry is 
a recognized branch of medicine; while clinical psychology 
must, as yet, be considered in the relation of an auxiliary, con- 
sultative specialty. 

Important work lies ahead in bringing the medical and psy- 
chological professions into mutual association ; and perhaps the 
organization which we contemplate may further that work. 
There is another field of medicine where cooperative relations 
remain to be established. This is in the important branch of 
Pediatrics. The whole pre-school period from birth registra- 
tion to entrance upon school life is destined to become of in- 
creasing importance from the standpoint of public health, of 
public education, and of human engineering. The activities in 
this field at present are largely medical in their character and in 
their administration. Pediatrics as a division of clinical medi- 
cine or in a broader sense, as a division of public health holds 
tremendous possibilities. These should in some way be made 
to include the methods and spirit of clinical psychology. An 
alliance of some kind must be worked out, or there must be an 
increase of the type of pediatrician whose equipment includes 
clinical psychology. 

Should not courses in mental development, clinical psychology 
and mental hygiene become an accepted part of a medical edu- 
cation, and particularly part of the training of tl\e school physi- 
cian and the pediatrician ? And, should not our organization 
further a movement in this direction ? It should be the function 
of the association to promote clinical psychology as well as 
clinical psychologists. Nothing will so widely diffuse the bene- 
fits of clincial psychology as a proper coordination with the 
education of medical students, of public health nurses, school 
nurses, and medical inspectors. 

"Clinician" is one of the most respected and significant 
words in the domain of medicine. It will be fortunate if this 
word loses none of its dignity and flavor when transferred to 
the field of applied psychology. A good clinician, in medicine, 
is an expert who, without necessarily being an authority or 



Digitized by 



Google 



FIELD OF CLINICAL PSYCHOLOGY AS AN APPLIED SCIENCE 83 

even an investigator in any particular phase of medicine, has 
so mastered the pertinent principles of his medical science that 
he can, in the presence of perplexing ambiguities and compli- 
cations, make a shrewd estimate regarding the conditions and 
outlook of his patient. He can summon a large amount of 
previous experience to bear upon his problem. By virtue of 
his trained perceptions and his native good judgment he can 
draw a conclusion which has professional and practical value. 

Clinical psychology has not yet become as refined, as exact, 
nor as complex as clinical medicine ; but if it is to be worthy of 
a similar position in the field of applied science, it must protect 
its standards. Quackery and charlatanism should be exposed 
and opposed ; and methods must be found for guaranteeing and 
certifying proficiency. 

The establishment of standards is the most concrete and 
essential function which an American Association of Clinical 
Psychologists can fulfill. This fact at once raises a question 
in regard to our relation to the American Psychological Asso- 
ciation. The latter association, contemporaneously with the 
inception of the A. A. C. P., appointed a Committee on Qualifi- 
cations for Psychological Examiners and other Psychological 
Experts, with a Sub-committee on Certification. Certainly this 
creates a situation which is in need of adjustment. It is by no 
means an ominous situation, for practically all of the members 
on the committee of the A. P. A. are also charter members of 
the A. A. C. P. There should, however, be a prompt readjust- 
ment so that there will be no conflict or duplication of activities. 
One solution of the situation is to convert the impending A. A. 
C. P. into a sub-section of the A. P. A. The writer would 
prefer two discrete organizations with an official afliliation. 
This would preserve the close relations with the parent organi- 
zation which are highly desirable, but leave sufficient freedom 
for prosecuting the ends for which the A. A. C. P. was 
designed. 

Whether evidence of expertness in clinical psychology is to 
depend upon certification, or upon membership in the A. A. 
C. P. is after all mainly a matter of detail and administrative 
policy. We are in no way anxious to create a new academy of 
immortals, but our aim is to erect high standards for a branch 
of Applied Psychology and for a possible profession. 
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Henry H. Goddard, Bureau of Juvenile Research, Columbus, 

Ohio 

One of the original Binet tests was " What happens when 
two people discuss a subject without understanding the words 
they use? " Most of us know what happens, and yet we are in 
great danger right now of committing the folly in spite of its 
known consequences. 

Some of us who think we are clinical psychologists think we 
want an Association of Clinical Psychologists. If it were an 
informal affair the task would be easy — we would simply pick 
out the gfoup of people we would like to have associated with 
us and the thing would be done. If we only wanted a neigh- 
bors' club this would do. But we are looking for something 
more formal, an association that would stand for something. 
An association to be a member of which is not only an honor 
but a certificate of standing. Our membership, therefore, must 
be based upon something more than personal preferences. 
Whether we organize an association of clinical psychologists or 
whether we organize a clinical division of the .^nerican Psy- 
chological Association in either case the members must be 
clinical psychologists. 

What is a clinical psychologist ? There is the rub — nobody 
knows. And nobody knows because the expression is a new 
one, relatively, and we have not agreed upon what we wish it 
to connote. The first thing to be settled, therefore, is — what 
do we wish the term to include? Not what does it include, 
because as already stated it is a new expression and includes 
nothing. As everybody knows clinical is a medical term which 
we are taking over into applied psychology, and since we are 
straining its meaning somewhat in applying it to psychology at 
all we can stretch it as much as we see fit and make the term 
mean whatever we like. It will, of course, get its meaning 
from the group to which "it is applied. 

Let us first see what it is that we are using. Clinic as a noun 
applies to " the teaching of medicine and surgery practically, 
at the bed-side or in the presence of patients." Clinical is an 
adjective ; " of or pertaining to a sick-bed." A clinician " is a 
physician whose method of treatment, observation, etc., are 
being based on clinical work. One who holds clinics or whose 
specialty is the giving of clinical instruction." From these 
definitions it seems that there are three ideas comprised by the 
term : first, bed-side ; second, sickness ; third, teaching. Medi- 
cal usage has already freed itself from the strict bed-side idea 
as witness the out-patient clinics. Also they escape more or 
less from the teaching idea. These same out-patient clinics 



Digitized by 



Google 



FIELD OF CLINICAL PSYCHOLOGY AS AN APPLIED SCIENCE 85 

very often have nothing of the teaching side connected ^th 
them, nevertheless, the physician in his office who sees patients 
and examines them during office hours does not call that a 
clinic. The one thing that does remain is the idea of sickness. 
Physical examination of well people is not called a clinic. 

Returning now to the psychological use of the term we know 
that about all that is left if we consider all the ways in which 
the term has been used, is the idea of personal exam^lation. 
Indeed if we should ever come to call the person whose only 
training and experience is in giving group tests, a clinical psy- 
diologist we would have thrown away the last vestige of the 
original significance of the term clinical. The teaching idea 
does not hold. If the time ever comes when one teaches psy- 
chology by means of clinics they will undoubtedly be called 
psychological clinics, but that is insignificant at present. The 
ocJy thing left is the sickness side. Shall we confine its usage 
to something that is at least analogous to sickness ? or, shall we 
break away altogether and allow the term to be used for any 
mental examination? It seems to the writer that the latter 
procedure would be a mistake and that much of the present 
confusion as to what shall be the qualifications of membership 
in the proposed association of Clinical Psychologists arises 
from the extension of the term clinical psychology until it 
is practically synonymous with applied psychology. 

Would it not simplify the whole situation if we were to agree 
that as related to the practice of psychology, clinical should 
mean personal examination of some one who is mentally- abnor- 
mal, or subnormal, leaving those psychologists, who apply the 
science to determining what the special traits of a normal indi- 
vidual may fit him for, to form a separate group, possibly to be 
called vocational psychologists ? And again those who make a 
specialty of applying the laws of mind to industrial efficiency to 
constitute another group, the industrial psychologists? Surely 
these are three quite different fields. The clinical psychologist 
as thus defined need know nothing of vocational guidance or 
industrial psychology, any more than a physician needs to be a 
clergyman or a lawyer. Or, if the illustration is better, any 
more than the physician need to be an expert surgeon or an 
oculist. If this view could be accepted it would indeed go a 
long way toward settling the other problems that we are facing 
whether the clinical psychologists will form an independent 
association or ask to be set off as a division of the A. P. A. 

The number of clinical psychologists, under this definition, 
is as yet too small to warrant the establishment of a separate 
organization. We are too few to obtain the purposes which we 
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have declared as those of such Sn organization. Nevertheless 
it is highly desirable that the clinical psychologists be recog- 
nized, that standards of training and experience be established 
before the group becomes so large as to be un wieldly and before 
it includes persons that do not have qualifications that are 
recognized as essential. In accordance with this plan the 
A. P. A. might at once divide itself «^jp at le^t five |^i;Qpp^ 
or more if needed : the pure psychologists, educational psycholo- 
gists, clinical psychologists, vocational psychologists and indus- 
trial psychologists. Each of these would in time perhaps, if 
not at once, subdivide again ; for example, clinical psychology 
might divide itself into perhaps three groups : those devoted to 
the study and diagnosis (1) of mental arrest, (2) of mental 
disease, and (3) of crime and delinquency. Of course these 
somewhat overlap and run into. each other, but that is true of 
all specialization and only means that those who devote them- 
selves to crime and delinquency must be clinical psychologists 
in a broad sense to the extent that they recognize mental disease 
and mental arrest. This seems like a logical development of 
the A. P. A. 

If, on the other hand, we make the term clinical synonymous 
with applied and form an idependent association of clinical or 
applied psychologists there will inevitably be sooner or later a 
breaking up of the present membership of the A. P. A. into 
two groups. While we would attempt to keep up our intrest in 
both associations it would inevitably result in a division. 

The result of the work of the psychologists in the war has 
demonstrated clearly that psychology has a practical side and 
the people are conscious of that fact and are going to more 
and more insist that psychologists help them solve their 
problems. This means that the field of applied psychology is as 
wide as human activity and we will more and more devote our 
knowledge of the science of mind to the practical solution of 
htmian problems. Psychology is today able to do more for 
human efficiency than perhaps any other science. It is possible 
to take a child and after a careful clinical examination make a 
diagnosis which in thousands of cases saves the wasted energy 
of years in the old trial and failure method of education and 
industrial activities; and yet we have made only the merest 
beginning. The work is destined to spread very rapidly and 
cover an enormous field and if done rightly and wisely will per- 
form an enormous service to humanity. 

In the nature of things, however, there will be enormous 
abuses. Just as the public was for years preyed upon by medi- 
cal quacks and patent medicine venders, so there will be innu- 
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merable charlatans practicing under the name of psychologists. 
This is inevitable. There is probably no way to prevent it but 
much of the evil can be headed off by vigorous action on the 
part of an organization of bona fide psychologists. It would 
seem that the American Psychological Association with its more 
than a quarter of a century of work, its carefully selected 
membership has a tremendous advantage, in carrying out this 
work, over any separate organization that would be formed. 
Moreover, we must not overlook the possibility of organiza- 
tions in the bastard group who will go into this work purely 
for financial reasons, moreover there is nothing to prevent them 
from taking high sounding names that will attract the public 
and make the work of the true psychologist so much more 
difficult. In view of all these considerations I question whether 
we can at this time aflford to run the risk of dividing our forces 
by the organization of a separate association of clinical psy- 
chologists, whether we use the term in the limited sense for 
which I have spoken or whether we use it in the broader sense 
as practically synonymous with applied psychologist. As mem- 
bers of a division of the A. P. A. we would all be bound together 
with strong esprit de corps; we would hold our meetings 
together and would have an ever increasing influence and power 
with the American public. 

J. E. Wallace Wallin, Psycho-Educational Clinic and Special 
Schools, St. Louis. 
In the field of medicine the connotation of the word 
" clinical " is perfectly well fixed. The clinical method refers 
to the direct examination of the individual patient by any or all 
of the approved methods of modem medical science. The aim 
of the examination is : first, to classify or diagnose the disorder 
or disease upon the basis of the etiology, which frequently can 
only be done by a systematic, comprehensive examination of 
the individual ; second, to prescribe a course of curative treat- 
ment ; and, third, to make a prediction of the probable outcome 
of the treatment and the future course of the malady. Of 
course, the physician may examine normal, healthy indivijduals 
as well as those who are ill, but in practice the time of the vast 
majority of medical men is given to the examination and treat- 
ment of the diseased and disabled. At the present time we note 
a growing tendency to place the chief emphasis upon the pre- 
ventive aspect of medicine, and the interest in preventive 
medicine has already led to the development of a new profes- 
sion, and the establishment of a new degree, the Doctor of 
Public Health. This type of doctor is not primarily, if at all, 
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engaged in the work of clinical examination, but is concerned 
with maintaining the public health by the control and regulation 
of the sanitary agencies affecting the well being of the entire 
community. 

To prepare competent clinical practitioners the medical 
schools have established courses of instruction only part of 
which are clinical in nature, but all of which serve to prepare 
the student for the strictly clinical branches in the upper years 
of the course. The degree of M. D. is not conferred upon any- 
one who has not completed all of the preparatory and clinical 
courses. In addition eight medical schools now require at least 
one year of clinical practice in a hospital internship before con- 
ferring the degree. No one is admitted to membership in the 
largest and strongest organization in the medical profession, 
the American Medical Association, who is not a " legally regis- 
tered physician." In only a few states is it possible to register 
as a physician without the M. D. degree. To still further safe- 
guard the interests of the public, no one is allowed to practice 
medicine who has not received a state license. 

Now, I take it that the situation in clinical psychology, with 
reference to the significance, purpose, demands and responsibili- 
ties of psycho-clinical work, does not differ materially from the 
clinical situation in medicine, at least so far as concerns work 
with the mentally disordered or deviated. Let us now briefly 
emphasize a number of propositions which are germane to a 
consideration of the field of the clinical psychologist and the 
plan of organization of this Association. 

First, no matter how valuable the results from group psycho- 
logical tests may be for the relative rating of the members of a 
group or for securing preliminary data, it is questionable 
whether we are justified in considering group testing as clinical 
testing, and classifying group testers as clinical examiners. The 
clinical examiner may employ group tests, but he is not a clini- 
cal examiner unless he analyzes (or diagnoses) each case on 
the basis of an individual examination. A clinical examination 
^in psychology, as in medicine, always means an individual 
examination of a subject. 

Second, the field of clinical psychology in the past has, in 
practice, been largely restricted to the examination of mentally 
deficient, backward and delinquent subjects, and possibly the 
psychotic, although the workers among the insane have usually 
not classed themselves as clinical psychologists. Theoretically, 
however, the field of clinical psychology is coextensive with the 
field of individual psychological examination. The clinical 
psychologist may devote himself to the study of the feeble- 
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minded, backward, normal, supernormal, the delinquent, the 
dependent,' the pauper, the hobo, the psychotic, the specifically 
mentally handicapped, the applicant for vocational guidance, 
the person who wishes to know whether he possesses aptitude 
for a special craft, art or profession, the army and navy recruit, 
with a view to insure placement in the proper arm of the fight- 
ing forces, etc. But can we classify any investigator of these 
classes of individuals and of these problems, no matter how 
meritorious his work, as a clinical psychologist unless he utilizes 
the clinical method of individual examination? Testing army 
recruits in groups of hundreds by means of intelligence test- 
blanks doubtless under favorable conditions gives a fairly re- 
liable and valuable relative intelligence rating, but such an 
examination is no more clinical than a class examination 'in 
geography or reading, and such a group tester is no more to be 
considered a clinical examiner than a teacher who conducts 
class tests in the school branches. When the clinical method 
is used, however, there is theoretically no limit to the psycho- 
logical problems which may come within the scope of clinical 
psychology. 

Third, the purpose of a clinical examination in psychology, 
just as in medicine, is: (a) the making of a correct diagnosis 
of the case, which involves the elaboration of a clinical picture 
of the mental conditions found at the time of the examination, 
and the detection of the etiological factors responsible for the 
ascertained mental deviations; (b) the rendering of the advice, 
or the prescription of the educational and social treatment 
which is indicated by the diagnosis, together with the rein- 
forcement of recommendations for physical treatment made by 
competent medical examiners ; and (c) the making of a reliable 
prognosis, so that the treatment or training may be effectively 
directed toward the best development of the individual. Who- 
ever fails to realize all of these aims only partially performs the 
functions of a clinical psychologist. Whoever has been trained 
to do less than this, has been inadequately trained for clinical 
work in psychology. Certainly so far as concerns the mentally 
pathological or abnormal or anormal classes, the clinical psy- 
chologist, just like the physician, must deal with etiological fact- 
ors and not merely with symptoms. Just as the physiologist or 
the anatomist, no matter how much he may know about the 
human body, is not a physician because he does not employ the 
complete clinical procedure, in the use of which he has no 
special fitness, so the general, experimental, educational, or 
physiological psychologist is not a clinical psychologist, no 
matter how much he may know about the mind, unless he has 
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been specially trained to use the clinical procedure. There- 
fore — 

Fourth, to become a competent clinical psychologist, just as 
to become a competent examining physician, requires a course 
of special training. A course of training in the ordinary 
branches of psychology which is entirely adequate to produce 
a good teacher or investigator in those branches is not sufficient 
to produce an efficient clinical examiner in psychology. But the 
training needed in addition to the basic psychological, biological 
and scientific training will differ according to the field in which 
the clinical psychologist is engaged, and will have to be gradu- 
ally determined by the consensus of opinion of the workers 
engaged in each specialized field. The strictly professional 
training — «. e., the training beyond the basic psychological and 
scientific training — which will qualify a psychologist for 
skilled work among the psychotic, will not qualify him to 
diagnose and direct the educational treatment of feeble-minded, 
backward, speech defective, alexia — or dyslexia — or merely 
pedagogically handicapped school children. Nor will the train- 
ing which qualifies one for efficient work among these types of 
handicapped school children produce an expert on the selection 
of successful salesman or on the proper placement of army 
recruits, or on the direction of courses of instruction for super- 
normal children. The different fields of clinical psychology 
have their own special and unique problems, the proper hand- 
lingjof which requires special study and skill in the particular 
field concerned. Doubtless the technical differentiation of psy- 
chological specialists will so develop that in future we shall 
have some psychologists who will specialize on feeble-minded 
children and adults, others will specialize on backward and 
specifically handicapped school children, others on delinquents, 
others on bright and talented children, others on the selection 
of employes, etc. 

This is not the place in which to attempt to outline the kind 
of differential training which clinical psychologists working in 
different fields should have. But we may indicate briefly, by 
way of illustration, the training which we believe workers must 
have who would render skilled service in the psychological 
examination of> mentally and educationally handicapped .school 
children, and in the supervision of educational work in their 
behalf.^ 

^ For a further discussion of this question, see our article on The 
Field of the Oinical Psychologist and the Kind of Training Needed 
by the Psychological Examiner of Mentally and Educationally Devi- 
ating School Children. School and Society, 191 9, p. — . See also The 
MentcU Health of the School Child, 1914, pp. ii4f, 134, 136, 210, 2i6£. 
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1. The basic trainii^f in the various branches of psychology. 

2. Special training in clinical psychology, including training 
in the administration of the current tests used in individual 
examination, the practical clinical examination and the working 
up of case reports of at least 200 cases, in course, and prefer- 
ably a post-doctorial year in a position corresponding to a 
medical internship, in which studies would be made of various 
types of deviating children, especially the feeble-minded, back- 
ward, epileptic and psychotic. 

3. Various pedagogical courses, particularly courses on 
standardized educational tests ; on primary methods of teach- 
ing, especially the teaching of reading, spelling and number, 
and the kindergarten and sensori-motor exercises ; on the psy- 
chology and pedagogy of the feeble-minded, backward, and 
speedi defective, and children with specific sensory defects, 
particularly visual and auditory, and with specific defects in 
reading, writing, spelling and number ; and practical courses in 
the various t3rpes of handwork which should be offered mental 
retardates. 

4. Social pathology, including a study of the social, voca- 
tional and criminal aspects of mental deficiency and defect. 

5. A minimum amount of medical training, m order that the 
clinical psychologist may secure proper perspective in the work 
and be able properly to interpret the medical reports, including 
courses in physical diagnosis, pediatrics, orthopedics, ear, nose 
and throat disorders, mental deficiency from the physical pojnt 
of view, neurology and psychiatry, and practical case writing, 
including the study of the subject's developmental and family 
history. 

It must be quite evident that while the above course of train- 
ing would qualify a psychologist for skilled service with educa- 
tional deviates — and we doubt that a less thorough course 
would do this * — it would not qualify him for expert service in 
many other fields of clinical psychology. We doubt that any- 
one would propose the above course of instruction in its entirety 
for a student who was preparing to make psychological studies 
among the insane, or who was qualifying as an expert on trade 
tests or on the selection of salesmen. 

Fifth, owing to the important practical bearings of clinical 
work in psychology, only those should be accorded official or 

*How far the psychological examiners in the public schools of the 
country fall short of a lower standard of preparation than the one 
suggested above, was indicated by the study of our questionnaire re- 
turns from 302 cities in 1913. In our judgment only about 25% of 115 
psychological examiners at that time were qualified for the work. 
Cf. The Mental Health of the School Child, 1914, 392L 
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professional recognition as clinical psychcdogists who have been 
adequately prepared. The organization of an association or 
associations, with rigid eligibility requirements, will do much to 
bring about the proper training of examiners and secure for 
them the recognition to which their professional qualifications 
entitle them. 

If the above conclusions are correct, the following corollaries 
would seem to follow. We do not submit them in a dogmatic 
spirit, but rather as suggestions which we think should be ade- 
quately considered before a constitution is adopted by this 
Association. 

First, no one should be eligible for membership in the Ameri- 
can Association of Clinical Psychologists unless he is at the 
time of election holding a position in which he is regularly 
devoting at least a portion of his time to actual psycho-clinical 
examinations, or unless he has in the past devoted a considerable 
portion of his time to genuine clinical work. Possibly it were 
wise to make an exception in the case of teachers who are train- 
ing students in mental testing and of research workers who are 
perfecting and standardizing psychological tests which will be 
of value in individual examinations. It is evident, however, 
that teachers will not be especially qualified to train the students 
in the art of clinical diagnosis and treatment, which involves 
more than training the students to administer psychological 
tests, unless they have had actual, first-hand clinical experience 
and are devoting some of their time to clinical examination. 
And yet we must recognize, from what has already been said, 
that the necessity of having clinical experience and doing clini- 
cal work, will vary with the type of problem. 

Second, no one should be eligible for membership who has 
not taken the Ph. D. degree in the various branches of psy- 
chology in an institution of recognized standing ; and who has 
not published or prepared for publication a valuable contribu- 
tion in the field of mental tests or clinical psychology. 

To this condition it is probably advisable to make one excep- 
tion : a holder of an M. D. degree may be admitted if he has 
had special training in psychology and considerable experience 
in making individual psychological examinations and diagnoses, 
and if he has made valuable contributions in the field of mental 
tests and clinical psychology. 

The suggestion has been made that the rank of associate 
membership be established for psychological technicians or 
testers who cannot qualify under the above conditions. We are 
inclined to doubt the advisability of this suggestion. One of 
the chief aims of the Association should be to develop the 
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highest standards of work in the field of clinical psychology, in 
order that properly trained clinical psychologists may secure 
the emoluments and recognition to which their special prepara- 
tion and fitness entitle them. We shall probably secure a large 
number of applications for membership from persons who wish 
to profit by the prestige which membership will confer who 
should not be given this recognition if their basic and profes- 
sional training and experience are inadequate. In this connec- 
tion, however, we may raise the question whether it would not 
be advisable to call the members of the Association Fellows 
rather than Members. 

Third, in addition to the above two general conditions, a can- 
didate to be eligible for membership must have secured a special 
or technical preparation in addition to the basic work in experi- 
mental, educational and other branches of psychology. This 
strictly technical preparation, however, would have to differ, 
as we have already stated, according to the particular field in 
which the psychological examiner is engaged. If this is so, 
it is impossible to outline the detailed professional training 
which a candidate for membership must have, unless the Asso- 
ciation is divided into sections. Every section would then have 
to determine upon the necessary technical training needed for 
membership in its own section. Under such an arrangement 
every candidate would have to meet two requirements : first, 
the general conditions for membership imposed by the associa- 
tion at large — say, the first two conditions given above — and 
second, the special conditions required by the individual section. 
If this plan were approved, we should probably have the follow- 
ing sections : Mental Deviation, including mental retardation 
and deficiency and possibly specific mental deviations ; Mental 
Disorder, dealing with various grades and types of psychotic 
disorders ; Crime and Delinquency ; and Trade and Vocational 
Testing. Other sections would eventually emerge as the prob- 
lems become more clearly defined, because the progress of the 
science will doubtless be toward greater and greater differentia- 
tion of special fields. The American Medical Association now 
has 16 sections in its Scientific Assembly, and in addition five 
councils which make recommendations in the interest of 
physicians. 

One of the practical arguments for establishing the sections 
is that this will make it possible to more fully realize the aims 
of the association to establish high standards of professional 
qualifications for clinical examiners in psychology. According 
to the plan of organization as at present proposed, it is im- 
possible to define satisfactorily the strictly technical qualifica- 
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tions which a clinical psychologist should possess in order that 
he may be rated as proficient or in order that he may be eligible 
for membership, because the requirements which are applicable 
to one type of examiner are not applicable to another type. 
The Association already has in its membership persons who 
should be distributed in several sections, while applications in 
future will no doubt come from persons representing very 
diverse interests. Recently a western state adopted a statute 
according to which no one can be appointed as a clinical psy- 
chologist to one of its state institutions for the feeble-minded 
who is not a member. of the American Psychological Associa- 
tion. But the majority of members of that Association have not 
made any technical study of f eeble-mindedness at all, so that the 
fact that one is a member of this Association does not constitute 
him in expert on feeble-minded children. But the same, criti- 
cism applies also to this Association. Membership in this Asso- 
ciation, according to the present plan, does not indicate whether 
the person is qualified to do work with feeble-minded or 
backward school children, or with the insane, or the delinquent 
or the normal, or any other class. The establishment of a 
number of sections, with membership limited to the experts in 
the particular field of each section, in accordance with the 
present practice of the American Medical Association, would 
have the merit of indicating the particular specialty of each 
member. Would it be worth while to divide the Association 
up into sections to gain this advantage ? I believe that it would. 
But there may be weighty practical objections to sectionalizing 
the membership. The aim of the writer is merely to offer the 
suggestion, in order that the whole matter may be fully con- 
sidered before final action is taken. 

If the suggestion were adopted, however, the Association 
could adopt the general conditions for membership at this meet- 
ing, while the specific technical qualifications would have to be 
worked out by committees of the^various sections which would 
be authorized. These committees would report their recom- 
mendations to the individual sections for adoption at the next 
annual meeting. No new members ought to be elected until the 
sections had determined upon their eligibility requirements. 

A further suggestion has been made that the title of the 
Association be changed to the American Association of Consult- 
ing Psychologists, or the American Association of Applied 
Psychologists, and that sections be established to include all 
the important applied divisions of psychology. The scope of 
' such an Association would be broader than that contemplated 
by the present Association, as non-<:linical workers would 
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evidently be eligible for membership. If eligibility to member- 
ship in the Association of Clinical Psychologists will be limited 
to persons who are engaged in genuine clinical work, at least 
on a part-time schedule, or have been thus engaged, this expan- 
sion of the Association is probably not advisable. But if 
eligibility will not be so limited, it would seem to the writer 
that either of the other two titles will more correctly express 
the scope and purpose of the Association. 
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Paul Popenoe and Roswell H. Johnson. Applied Eugenics. THc 
MacMillan Company, New York, 1918. p. 443. 

This book, while bound to provoke vehement discussion, is as surely 
bound to afford no small amount of satisfaction to those who have 
felt acutely the want of a thorough-going treatment of the principles 
and program of the eugenic movement, since gross misunderstanding 
and misuse of the term Eugenics still persists. 

For the first time we are in possession of a balanced study of ade- 
quate length, which escapes being a primer or a profoundly technical 
volume. It is greatly worth the waiting for. 

The lay reader will be impressed with the incisive refutation of 
popular confused assumptions involved in the old debate upon the 
relative importance of heredity and environment The lines of evi- 
dence, statistical and experimental, indicating that differences in a 
trait are more affected by differences in nature than by differences in 
nurture, are drawn from the Galton, Thomdike, aiid Pearson investi- 
gations and from the researches in families of distinguished persons 
made by Woods and Cattell. The latter's study, however, only indi-. 
rectly proves the author's point in that it serves to call attention to 
the complex interrelation of environmental factors operating upon 
traits inherent in original nature. 

A discriminating analysis of the problem of germ plasm modifia- 
bility is provided. Current misconceptions concerning the transmission 
of characters are summarized and the actual significance of data 
traditionally alleged to show it is thoroughly pointed out 

Contemporary psychologists and biologists need no new treatise on 
the distinction between the conditions affecting germ plasm and soma 
plasm or upon the capacity of natural selection to account for pro- 
gressive and retrogressive changes in the race. What we did need 
was an authoritative and at the same time readable presentation of 
the facts for non-scientific persons, many of whom, though academic- 
cally trained, are still advocating as eugenic various agencies on the 
false supposition of their fundamental power for racial betterment 
This need is met in a book likely to surprise, inform, and convince 
such individuals if they can be induced to read it 

Furthermore the doctrine regarding " racial poisons " is stilt tena- 
ciously held by many sociologists, social workers, psychiatrists, and 
clinical psychologists, unaware of the recent results obtained through 
close laboratory scrutiny of the subject These students fall into two 
classes: those unconscious of the fact that the influence of alcohol, 
for example, upon the mechanism of heredity is a matter even open 
to discussion (as two persons who are regarded as experts in the field 
of social science recently confessed their ignorance to the reviewer) ; 
and those who, aware that it is questioned, resent what they deem 
audacious and preposterous attempts to minimize the baneful effects 
of alcohol upon the mind and body. 

The authors give a critical resume of the evidence on both sides of 
the controversy. They further augment the weight of the argument 
against transmission of acquired characteristics by an admirable crit- 

96 . 
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ique of the time-honored belief in prenatal culture. In emphasizing 
the conclusion that eugenics is obliged to concern itself solely with 
the material in the germ plasm which cannot be permanently modified 
by external influences, and that hence the only means to race better- 
ment is through changing the birth and death rates to alter the relative 
proportions of good and bad germ plasm in the race, the authors are 
by no means scornful of EuSienics. It is to be expected that they 
will be wrathfully accused by superficial readers of denying the good 
accruing to the individual and society through all the reform move- 
ments of the day, in spite of numerous explicit statements such as 
this : " Eugenics ...» is inadequate unless accompanied by constant 
improvement in the surroundings; and its advocates must demand 
euthenics as an accompaniment of selection, in order that the oppor- 
tunity for getting a fair selection may be as free as possible." 

The chapters dealing with mental differences and inheritance of 
mental capacities are well handled from the standpoint of a disciple 
of the Thomdike school upon whose work the authors draw heavily. 

Although their resume of the literature dealing with the comparison 
of the white with the negro races is excellent, psychologists will be 
quick to note the omission of reference to Woodworth's and Bruner's 
work on Racial Differences in Mental Traits and Thomdike's pene- 
trating valuation of the facts. The desirability and possibility of en- 
forcing restriction on marriage and parenthood among the dysgenic 
classes is argued on biological, humanitarian, and economic grounds. 
Legislation of genuine eugenic value would be segregation, differently 
drafted sterilization and divorce laws, and repeal of laws prohibiting 
marriage between cousins. 

In the chapter on Improvement of Sexual Selection the authors state 
what they call the psychological point of view in support of the claim 
that eugenic ideals can become a part of the habits and "conscience" 
of the race and the selection of life partners unconsciously influenced. 
The authority cited for this belief appears to be Galton alone. Wat- 
son's advocacy of experimental study in the control of emotions and 
the application of the theory of the *' conditioned reflex " as a means 
of reaching such an end has been overlooked. 

One of the features of the book which bears the distinction of 
original contribution is the chapter pointing out the eugenic aspects 
of certain specific laws, movements, and reforms, e. g.. Democracy, 
Socialism, Feminism, child labor, compulsory education, vocational 
guidance, minimum wage, trades unionism, housing, pensions, taxation, 
prohibition, et cetera. The authors are not guilty of sweepingly 
branding these features of society eugenic or dysgenic, but cogently 
set forth their direct and indirect influences in respect to ultimate 
racial improvement through increase and decrease in relative propor- 
tion of superior and inferior strains in the population. The conclu- 
sions reached through adroit reasoning are perhaps more often unex- 
pected than not 

Any consideration of dysgenic effects of social amelioration must 
take into account that we do not know what the trend of variation in 
human beings is nor how natural selection is operating. On the other 
hand, conditions entailing a desirable high deadi rate of inferiors may 
at the same time prove unwholesome to the superiors as well and even 
actually create inferior variations unaware. Until we have experi- 
ments showing what environmental forces are the causes of varia- 
bility we cannot hope unerringly to determine and eliminate the true 
sources of deterioration. 
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There are certain infelicities of diction and noticeable typographical 
errors, but it is none the less an admirable specimen of book-making. 
The interest of the discussion is enhanced by copious and effective 
illustration. 

Smith College. Miriam C. Gouu). 

Helen Marot. Creative Impulse in Industry, A Proposition for Edu- 
cators, E. P. Dutton & Company, New York, 1918, p. 146. 

This book, which carries the significant sutt-title, "A Proposition 
for Educators," is dedicated to " Caroline Pratt whose appreciation of 
educational factors in the play world of children, intensified for the 
author the significance of the growth processes in industrial and adult 
life." The author, analyzes the industrial system in this country and 
by contrasting it with the German system points out its inherent weak- 
nesses as well as the means of remedying them. "America wants 
industrial efficiency, it must have efficient workers if it holds its place 
among nations, and American people will prove their efficiency or 
their inefficiency as they are capable of using the heritage which in- 
dustrial evolution has given the world. But what shall we use this 
efficiency for? For the sake of the heritage? For the sake of busi- 
ness? For the sake of Empire?" 

Among the chief weaknesses of our present industrial system, ac- 
cording to the author, are the facts that we value possession of wealth 
more than its creation, that both capital and labor are interested in 
the exploitation of wealth rather than in its production. Consequently 
the manufacturers value the workmen merely as so many attachments 
to their machines which they would like to standardize, perhaps, by 
an industrial education, just as the other manufacturing processes 
have been placed on the highest basis of efficiency as measured by 
mass production. The monotony in labor brought about by thus divid- 
ing "the workers into eyes, arms, fingers, legs, the plucking out of 
some one of his faculties and discarding the rest of the man as 
valueless," his ignorance of the complete process of production, of the 
finished product and its final marketing, have produced in the laborer 
not only a mental state of indifference to his work but also a dis- 
inclination to produce, which in the long run may offset such artificial 
stimulants and inducements to higher efficiency as better wages, com- 
fortable and safer working conditions, means of self-improvement, 
and selection for positions and advancement to better positions on the 
basis of greater fitness. It would be useless to revert to and repeat 
the experiences of praftmanship and the Guilds of an earlier age, 
since our present state of society has evolved from it Other sug- 
gestions for correcting the evils of our present system are not prom- 
ising, since they fail to appeal to the worker's impulse of creativeness. 
The author then goes into some detail, in the second chapter, to show 
how only partially successful in this respect the efforts of scientific 
management have been except in so far as they incidentally and acci- 
dentally involved this impulse. Another chapter is devoted to the 
attempt at showing that the German paternal system of industrialism 
for the glory of the empire would be absolutely impossible for the 
American people, even if greatly modified and in spite of our recent 
favorable experiences in governmental control for the purposes of 
carrying on the war. 

The author's own positive suggestions for remedying the most seri- 
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ous evil of our present industrial system consist in demonstrating the 
possibilities for developing a socialized productiveness in the workers, 
by utilizing or appealing to their '* orginating, choosing, adapting 
power." She says, " the creative eflfort is not necessarily an individual 
matter. It may be possible for a group of people to associate cor- 
dially and freely together with a single creative purpose and endeavor. 
It may be possible for each worker to experience the joy of creative 
work as he takes part with others in the planning of the work along 
with the labor of fabrication. It is a creative experience or dull labor 
as his association with others in the solution of the problem is freely 
pursued and genuine, or as it is forced and perfunctory" (p. 137). 
In this connection the author describes in some detail the educational 
experiment carried on by Caroline Pratt in New York City under the 
auspices of The Bureau of Educational Experiments, 16 West i8th 
Street. Miss Caroline Pratt, with the help of several adults, is con- 
ducting a Toy Shop with about forty pupils between 14 and 17 years 
of age. The pupils have here an opportunity to become familiar with 
all the technical, financial, administrative, economic, aesthetic and lit- 
erary processes involved in the production of marketable toys for 
American children. The practical value of such an educational ex- 
periment will depend upon the answers that it can make to such ques- 
tions as *' (i) Was the creative impulse aroused? (2) Were standards 
of workmanship discovered and sustained? (3) Was a broad as well 
as a working knowledge of subject matter acquired? (4) Did the 
children approach established methods in a spirit of hospitality and 
of inquiry as to their validity? (5) Did the problems create sufficient 
interest to arouse the desire and will to reject faulty methods, and 
introduce others of greater service? (6) Was the enterprise a pro- 
ductive one from the point of view of the market and an educational 
one from the point of view of growth?" (p. 133). 

The author recommends that educators cooperate with engineers and 
architects and the managers of industry in proposing a new program 
or system of production. She believes that " engineers, not under the 
influence of business, are qualified to open up the creative aspects of 
production to the workers and to convince them through their own 
experience that there are adventurous possibilities in industry outside 
the meager offerings of pay-day" (p. 109). She names Mr. Robert 
Wolf as one of the engineers who is ready for the adventure. In 
working out such a program " it will be the mission of educators to 
show that by opening up the field for creative purpose, fervor for 
industrial enterprise and good workmanship may be realized, that only 
as the contents of industry in its administration as well as in the 
technique of its processes is opened up for experiment and first-hand 
experience, will a universal impulse for work be awakened" (p. xx). 

Whether it may be granted or not that the book correctly diagnoses 
our present industrial defects, it fails to combat the employers' claim 
"that from 95 to 99 per cent of the working force is without pro- 
ductive impulse " (p. 134) by the only convincing argument to the 
contrary, the experimental demonstration of the universality of a 
creative impulse in human nature. In this respect the author's mere 
assumption of its existence is psychologically as unfounded as Veblen's 
assumption of an instinct of workmanship. To recommend sweeping 
educational and industrial changes on the basis of a new sociological 
hypothesis, because our present industrial system is faulty, amounts 
to suggesting the haphazard methods of trial and error instead of the 
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much slower but surer way of first establishing the psychological facts 
upon which the new sociological hypothesis must ultimately rest. 

L. R. G. 

Alice Minnie Herts Heniger. The Kingdom of The Child, (With 
an Introduction by G. Stanley Hall.) E. P. Dutton & Company, 
New York, 1918, p. 173. 

In her latest volume, Mrs. Heniger presents the psychological con- 
clusions which her fifteen years' work with the Children's Educational 
Theatre have enabled her to draw, and shows how they may be used 
as fundamental principles of ^modern pedagogy. The child's kingdom 
is the world of imagiilation, of make-believe, is her main thesis, and 
we must use this innate creative instinct in order to breathe the glow 
of life into our deadly school curriculum, and also to mold the char- 
acter and shape the personality of the children intrusted to our guid- 
ance. The vital mistake we have made as parents and teachers is 
our failure to recogize this basic tendency of childhood, as a result 
of which we have forced our children to repress their impulses toward 
self-expression, and made them become servile imitators of us, as 
adults too blind to see the longings and aspirations of their prisoned 
souls. 

Mrs. Heniger gives numerous examples which illustrate her point 
more clearly than any abstract discussion could ever hope to do. She 
cites cases of retarded children, with whom the ordinary school meth- 
ods have failed, and tells how, under the benign influence of the Edu- 
cational Theatre, their lives have grown fuller and richer in their 
strivings to interpret the characters assigned to them, so that the long 
denied promotion becomes an indirect result of this release of their 
inner life. She describes the months of arduous study put in by a 
little slum girl who wished to be able to play the part of a fashionable 
boarding school miss in " The Little Princess," and pertinently inquires 
whether any other motive could have induced her to work so eagerly to 
acquire the traits of personality and social grace of a type far outside 
her personal experience. For these children, starved by their environ- 
ment, seek to enter another world vicariously through the gates of 
dramatic representation; they live the parts they play, — indeed, they 
must become the person in the story before they can hope to portray 
the character with any degree of success. Herein we have one .solu- 
tion of the problem of Americanizing our immigrant children; we 
have only to make them enter into the spirit of our great men, — ^as 
one little Russian lad did in his rendition of Lincoln's Gettysburg 
address, — to produce more loyal citizens than could be obtained by 
any amount of drill upon the Declaration of Independence as a mere 
rote memory lesson. It is only as they can enter into the lives of the 
men who created that glorious document, it is only as they, too, can feel 
the thrill of freedom and justice, that these foreign-born youngsters 
are made an integral part of our national life. 

In like manner, the subjects we wish to teach our children must 
become humanized, and must present to the child a many-sided con- 
tact with the great racial history of mankind. Literature lends itself 
particularly well to this interpretation, for under skillful guidance, the 
child enters into the soul of the heroes and heroines of whom he 
reads, and unconsciously strives to emulate their noble thoughts and 
lofty idealism. It is in the adolescent age of the high school and 
college that we see the student most affected by these inspiring ex- 
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amples; but even the tedious task of learning tb.reaSL/nay be made 
easy and pleasant if the teacher be wise enough to msjce.the cat a real 
cat, and the dog a barking, tail-wagging animal of dalhy.^.^quaintance. 

The Sunday School comes in for its share of censorship, jand nu- 
merous anecdotes are quoted to illustrate the hopeless inefficiency of 
well-meaning but unintelligent teachers, with their precise but.-unin- 
spiring presentation of facts. It is worth while to repeat one ol^.thtfsp. 
examples, for it drives the point home as nothing else could do. " 'tHt •' 
story was recounted to me," writes Mrs. Heniger, "of one such lady, 
who thought it would be appealing and helpful to tell her class the' 
story of Adam and Eve in her own language. She had read some- 
where about childhood's ready grasp of the objective lesson, so she 
decided to cut the story down to what she considered the level of the 
child's understanding. She was greatly pleased with her apparent 
success inasmuch as the class . . . listened attentively to her recital. 
But here is the way the brightest lad in the class recounted the story 
to a number of young friends. I repeat his language verbatim: 
/There was two of 'em, and they ate off the wrong tree, and the snake 
told on 'em, and he said she made me do it, and so God said you 
both go to Hell ! * " After driving home her argument by an an- 
thology of these childish observations, the author pleads for an inter- 
pretation of the bible which shall bring out all its mystic beauty and 
allegorical significance, and pleads for the utilization of the dramatic 
element in the Sunday School, emphasizing the value of biblical plays 
for the childish actors. 

While these details serve to show the style of the book, and the 
methods which it advocates, they can give no clear idea of the author's 
keen insight and breadth of vision. The scope of the work is partially 
indicated by the elaborate chapter headings: What Is the Kingdom 
of the Child and How Does the Adult Transgress in the Kingdom; 
How Can the Parent and the Teacher Enter with the Little Child into 
His Kingdom; Shall Parent and Teacher Be Subjects in the Kingdom 
of the Older Child or Shall They Be Rulers Therein; In the King- 
dom the Child Can Learn Best How to Know Himself by Being for 
a Time, Someone Else, but He Must Create Not Imitate, His New 
Character; In Every Child within the Kingdom Slumbers the Whole 
Experience of the Race and We, as Educators, Must Endow the New 
Spiritual Lives with Form and with Substance; How the Foreign- 
Born Child Is Brought into the Kingdom and Remains Forever After 
a Loyal Subject Therein; Learning to Read Is Never Dull and Tire- 
some when the Schoolroom Is a Part of the Kingdom; All the Great 
Heroes and Heroines of Literature Reside in the Kingdom where 
Children and Young People Crave to Be Yheir Daily. Companions, to 
Live with Them in Their Homes and to Interpret Their Thoughts; 
In the Kingdom, Literature is Regarded as an Expression of Our 
Common Humanity and Speech Is the Direct Medium from Soul to 
Soul ; The People Who, in Books, Seem to Be dead and Buried, Are 
All Alive when We Meet Them in the Kingdom; In the Bible Are 
Page after Page of Attractive Stories that Contain Guiding Lessons 
of Life; In the Kingdom, Bible Stories Are Shown as The Wonderful 
Symbolic Allegories They Are,, and Which Children's Pure Aspiring, 
Spiritual Imagination Really Imagines Them to Be; The Kingdom's 
Domain Stretches Beyond the Walls of the University, 'so that even 
a Staid College Professor May be a Dweller in the Kingdom if He 
Has a Mind to; The Real Kingdom Will Have a Children's Theatre 
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Where Good,JPlarJ«§"*Suitable for Children to See May Be Enjoyed; 
In the Kingdpin.a Little Child Shall Lead Us. 

In his it^twQdttction to the present volume by Mrs. Heniger, G. Stan- 
ley Haircfiv^cterizes it as "a real and original contribution to both 
educational methods and our knowledge of childhood." He might 
well'Jiave added that it is a book which should be in the hands and 
.mindl'of every mother and teacher, for it contains information which 
-' K'^vftal for the proper development of the child's social and moral 
nature. 

Phylus Blanchard. 
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AIR SERVICE TESTS OF APTITUDE FOR FLYING^ 



By V. A. C. Henmon, University of Wisconsin 

From the psychologist's point of view an outstanding feature 
of the war has been the demand for highly specialized abilities 
and aptitudes in addition to genei^l military virtues. No 
where has this been more true than in the Air Service and no 
where have the problems of selecting individuals and assigning 
them to the work for which they are best fitted been more 
urgent. As late as April 1917, the Aviation Section of the 
Signal Corps had but 52 trained flyers. The Air Service with 
upwards of 16,000 flyers is thus a new product. 

When war was declared the need for selecting thousands 
of men for training as pilots, observers and balloonists was 
met by the creation of Examining Boards and Physical Exam- 
ining Units. Rigorous physical and medical standards were 
adopted. While the mental, moral and professional require- 
ments were equally exacting the standards were necessarily 
vague and general. We were instructed to select men of good 
education and high character, men who were in every way 
qualified and fitted to become officers of the U. S. Army — a 
rather intangible set of specifications. We were constantly 
enjoined to remember that the flying officer was not to be an 
"aerial chauffeur," but a "twentieth century cavalry officer 
mounted on Pegasus." 

Examiners soon found that while it was relatively easy to 
pick men who could negotiate the non-Pegasarian flights de- 
manded in the Ground Schools, what they would do when 

* Paper prepared for joint meeting of Section H of the A. A. A. S. 
and American Psychological Association at Baltimore. Delay in se- 
curing approval of War Department prevented the reading of the 
paper. 
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they mounted Pegasus was a sheer guess. The result was that 
in spite of the Examining Boards and Physical Examining 
Units which eliminated 50 to 60 per cent of applicants, and in 
spite of Ground Schools, which eliminated 15 per cent of the 
survivors, there were still at least 6 per cent of men who 
reached Flying Fields who were discharged or transferred be- 
cause of inaptitude for flying. This estimate of 6 per cent 
was obtained from independent data obtained by Thorndike 
and myself. Thomdike's estimate is based on a follow-up of 
1,600 cadets who were admitted to Flying Schools and were 
either commissioned or discharged from flying status or killed 
in accident. Observations at Kelly Field showed that on June 
first, when 750 Reserve Military Aviators had been commis- 
sioned, 74 men had been discharged. Of these 55 were dis- 
charged for inaptitude or temperamental unfitness for flying, 
11 for physical disability or incapacity, 5 for misconduct and 
3 for technical reasons. In at least half the cases of discharge 
for physical unfitness this is but a euphemism for tempera- 
mental unfitness for flying. There were about 600 cadets at 
the Field at the time. Estimating the discharges or transfers 
that would accrue from this number the estimate of 6 per 
cent is conservative for Kelly Field. The recent report of the 
Director of Military Aeronautics for the period ending June 
30th, showed that at that time 4,980 men had been commis- 
sioned and about 400 had been dropped for inability to fly. 

Over and above the 6 per cent who failed completely there 
are a considerable number who, while ultimately commis- 
sioned, have no aptitude for flying, learn with difficulty and 
smash ships. For example, there were two men who were 
rated as very poor in flying and who did very poorly in the 
tests. One took 106 hours for his R. M. A. when the average 
time was well below 50 hours, and the other took 94 hours. 
These men were commissioned because it seemed better to use 
them than to discharge them and train others at great cost in 
their stead. The 74 men discharged wasted 1,400 hours of 
flying. Some statistician has figured the total cost of flying 
training as $2.00 per minute in the air. Whether this includes 
the cost of wrecked ships is not known, but this group wrecked 
not less than 30 ships. One man, for example, was given 55 
hours of flying instruction and wrecked five ships before he 
was relieved as "unadaptable for further training." The 
money cost of the trial and error method of discovering ability 
to fly, to speak merely of it, becomes enormous. It is unnec- 
essary to multiply evidence to show that the need for improve- 
ment in methods for selecting flyers was and is very great. 
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In June 1917 the National Research Council Committee on 
Aviation tried out tests reported as promising by French and 
Italian psychologists, and other tests as well, on 75 candidates 
at the Massachusetts Institute of Technology Ground School. 
This work was done by Burtt, Troland and Miles. Stratton, 
in August 1917, tried out tests on 50 flying cadets at San 
Diego, and Maxfield tested 44 cadets at Essington Field. Dr. 
Parsons in the early part of this year tested the cadets in the 
Naval Aviation Service at Massachusetts Institute of Tech- 
nology. In this way some forty odd tests had been given 
something of a try-out. The difficulty of securing satisfactory 
ratings of flying ability or of an adequate follow-up made the 
correlations, however, too uncertain for practical conclusions. 

In March of this year Captain Stratton and I were detached 
from Examining Boards to make, in cooperation with Thorn- 
dike of the Committee of Classification of Personnel, an official 
investigation of the most promising of the tests as shown in 
earlier studies and of others which seemed a priori to be worth 
investigation. It would be too long a story to list the forty 
tests, give the correlation with flying ability which they 
showed, and indicate the grounds of selection of tests for fur- 
ther try-out. Ability to fly would seem to require emotional 
stability and control or " nerve," sensitiveness to tilt, general 
motor coordination and control, quickness of response to visual 
and auditory stimuli and to changes of equilibrium, mental 
alertness, and athletic ability and interest. Tests of most of 
these traits had shown promise. These, and several others 
that gave no results worth noting here, were therefore selected 
and given to 300 cadets and flying instructors at Rockwell 
Field by Stratton and by myself at Kelly Field. At each field 
50 very good flyers, 50 very poor flyers, some of whom had 
already been relieved from further training for inability to 
fly, and 50 unknowns were given the tests. Each man was 
tested on two different days. The tests selected and given at 
both fields were as follows: 

1. Emotional Stability, a test which measures the liability of 
the subject to incoordinate purposeless reaction upon a receipt 
of a sudden shock, the discharge of a pistol. Measurements 
were made of amplitude of hand tremor, time of recovery from 
tremor, changes of frequency of pulse, changes in frequency 
and amplitude of respiration, and the effect of the shock on 
rate of solving examples in addition. Of these measurements 
amplitude of hand response and changes in frequency in 
respiration were found to be especially significant. 

2. Perception of TUt, which measures by means of a 
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Specially constructed tilting chair, the sensitiveness to gradual 
changes of bodily position. 

3. Swaying, a test of the motor coordination and control 
required for the subject to stand steadily with the eyes open 
and with the eyes closed. 

4. Visual Reaction, quickness of response to movement of 
the upper hand on the dial of the Hipp chronoscope. 

5. Auditory Reaction, quickness of response to the noise of 
the Zimmerman sound hammer. 

6. Equilibrium Reaction, quickness of response to sudden 
changes of bodily position, to the right and to the left. Burtt's 
tilting table, which gives a negatively accelerated tilt of con- 
stant distance and speed, was used. 

7. Equilibrium Differential, the sum of the visual and audi- 
tory reaction times minus the equilibrium reaction time, a 
measure of the relative quickness of the response to changes 
of equilibrium as compared with simple reaction times. 

8. Extension of Curves, a test roughly simulating the judg- 
ments of distance required in landing a ship. This test which 
showed promise in the earlier study by Stratton gave negative 
results in the later investigation. 

In addition to the psycho-physical tests two tests by means 
of blank forms were given. 

9. Thorndike's Mental Alertness Test, an arrangement of 
thirteen tests of various functions designed to measure native 
mental ability or general intelligence. This test had been 
adopted for use by Examining Boards and formed a regular 
part of examination procedure. 

10. Athletic Achievement and Interest. Thomdike's study 
of application blanks filled out by candidates and subsequent 
performance had shown a positive correlation between athletic 
ability and success in flying. A more detailed blank was pre- 
pared and a scoring system for it worked out by Thomdike 
and Kelly. 

In view of the fact that the Mental Alertness and Athletic 
Achievement tests were not given to enough men at Rockwell 
Field, and since they are in the series of tests recommended 
and adopted, I shall discuss the results from Kelly Field 
mainly. The instructors and cadets were rated in flying 
ability by the Officers in Charge of Flying on a basis of judg- 
ments of five stage commanders and the progress cards. All 
officers showed keen interest in the problem and the ratings 
were made with great care. 

The correlations with flying ability, the inter-correlations 
of each test with every other test, and the intra-correlations 
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between the trials on two days were determined. Taking into 
account all available data as well as the later investigations 
the correlations of the individual tests with flying ability are 
as follows: 

CORRELATI(»^ WITH FLYING ABIUTY 

1. Emotional Statnlity, K. F. 

1. Hand Reqx)nse 35 .26 

2. Changes in Fteq. of Reqnration. 25 .23 

2. Perception of Tilt 23 .26 

3. Swaying 22 .16 

(4. Visual Rcacti<Mi .15) 

5. Auditor]^ Reaction 14 .15 

6. Equilibrium Choice Reaction 15 .08 

7. Equilibrium Dififerential 18 — .15 

(8. Extension of Curves —.03 .14) 

9. Mental Alertness 35 .23 

10. Athletic Achievement 

The correlations in the first column were obtained by Shep- 
ard's formula. Those in the second column are the correla- 
tions from the Kelly Field data by the rank method. The 
figures in parenthesis are for tests not in the recommended 
series. 

The best tests, as the table shows, are emotional stability, 
especially the hand response, perception of tilt, and mental 
alertness. **With the material used the correlation between the 
Thomdike-Kelly athletic score in flying ability was over .6 
though certain factors were operative which make this pos- 
sibly too high and the number of cases was under 100." None 
of these tests alone obviously is a sure symptom for inaptitude 
for flying or a sufficient basis for prognosis. When, however, 
the individual measurements are combined the composite score 
obtained from the series or team of tests recommended gives 
a multiple correlation coefficient of .70, which is a sufficient 
basis for prognosis with some confidence. In selecting the 
team of tests those were chosen which show the highest cor- 
relations with flying ability, satisfactory reliability coefficients, 
and low correlations with each other. To determine the 
weights to be given each test toward the composite score 
would ideally require the calculation of partial correlations 
and coefficients of regression. The time and labor for this 
analysis has not been available. A provisional scoring and 
weighting scheme, scores being expressed as deviations above 
and below the mean of performance in the tests, was worked 
out. The weights were estimates made with due regard to the 
principles and factors that determine weighting by the partial 
correlation method. The success with which the recommended 
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tests segregate the poors and the goods is indicated in the fol- 
lowing table : 

Scores on Flying Ability op 100 Cadets and Instructors at 
Kelly Field 

Score in the Repent from Ayerage 

recommended flymg school Notes to date of June 15 dual time 

series of tests p-poor.g-good. of others 

— 75 or worse pppppp 4 suq)ended, relieved or discharged 15:50 
—50 to —74 ppppppg 4 " " " " 11:16 

—25 to —49 ppppppp 5 " " " " 10:17 

ppppppg 
Oto— 25 ppppggg 9 " " " " 10K)3 

PPPPggg 
ppppggg 
PPPP 
^ Oto— 25 ppggggg 1 " " " " 9:19 

U ' . —25 to —49 pgggggg 1 not reported 9:23 

^ ' ^^ pgggggg 

—50 to —74 ggggggg 7:50 

—75 or better g 7:21 

The acid test is, of course, the ability to predict. In order 
to eliminate the possibility of confusing abilities produced by 
flying with those prophetic of ability to fly, the tests were given 
to 50 cadets of unknown ability who had just reached the 
Field. Some of these had had no experience in flying and 
none over two or three hours of dual instruction. On a basis 
of performance in the tests solely I submitted to the Officer 
in Charge of Flying a prediction that five of these men would 
either be discharged or learn to fly with great difficulty. Two 
others were selected as showing special aptitude, one of whom 
because of deficiency in formal education had difficulty in 
getting into the Service. Of the five men three were dis- 
charged after 4, 20 and 22 hours of instruction respectively. 
One of these men wrecked two ships completely. The fourth 
man was relieved from flying at one time and brought before 
the Discharge Board but was given another chance and finally 
was commissioned after 85 hours of flying instruction when 
the median time for his class was 60 hours. The fifth man 
was commissioned after 93 hours of instruction. The Officer 
in Charge of Flying said of these men that they did " Fair " 
work. The two men who were picked to show exceptional 
aptitude were commissioned as pursuit pilots and their work 
characterized as " Very Good." One of the men made re- 
markable progress and was commissioned after 43 hours of 
flying when the median time was 70 hours. This was the man 
who barely met the educational standards. 
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The success with which the tests differentiated the goods 
from the poors and the correspondence between prediction and 
performance were sufficiently convincing so that the Personnel 
Section of the Air Service was authorized to proceed with 
their introduction. Steps were taken to organize four Per- 
sonnel Units to be established at the four Ground Schools and 
in affiliation with four Examining Boards. The all too familiar 
vexatious delays in securing necessary personnel and equip- 
ment prevented their being fully organized and actually in 
operation before the armistice was signed and Examining 
Boards and Ground Schools were closed. 

While waiting for personnel and equipment at Princeton, 
where the training unit was located, Captain F. L. Wells and 
I carried out a series of experiments with four subjects to 
determine (1) the susceptibility of the tests to systematic 
practice, (2) the advisability of repeating the tests on the 
same day instead of as heretofore on the next or some sub- 
sequent day, and (3) the eflfect of time of day on perform- 
ance in the tests. In the practical administration of the 
tests questions on these points would naturally arise and did 
arise. The tests, except those of mental alertness and athletic 
achievement, measure relatively simple functions that enter 
into flying ability. A priori one might expect, though one 
could not be sure without actual experiment, that these tests, 
having been highly practiced by the ordinary conditions of 
life, would not show very quick or very marked effects of 
practice or of diurnal variation. If this supposition holds, the 
tests are for practical purposes all the more valuable. The 
results show 

1. That except for the equilibrium choice reaction practice 
effects are slight for daily tests over a period of fifteen days. 
The practice effects, moreover, are least evident in those with 
the poorest initial scores. 

2. That the variability in the once-a-day tests is but little 
greater than in the twice-a-day tests. 

3. That time of day for all practicable purposes is negligible. 

The Air Service is certain to become an increasingly sig- 
nificant arm of the military forces and it is equally certain 
that aviation will have ere long important applications in civil 
life. The selection of the apt and the elimination of the unfit 
for flying is, therefore, so important that the responsible au- 
thorities should on a basis of the showing made be required to 
give the tests a practical try out and take steps for their im- 
provement, in order that vast sums should not continue to be 
expended fruitlessly and human life wasted. 
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MENTAL TESTS FOR PROSPECTIVE TELEGRAPH- 
ERS, A STUDY OF THE DIAGNOSTIC VALUE OF 
MENTAL TESTS FOR PREDICTING ABILITY TO 
LEARN TELEGRAPHY 



By L. L. Thurstone, Carnegie Institute of Technology, Pittsburgh 



This investigation was made to ascertain whether it is pos- 
sible to predict ability in telegraphy by mental tests. Our 
subjects were 165 drafted men of Class I, who registered for 
a night course in radio-telegraphy. The course was given at 
the Carnegie Institute of Technology to prepare drafted men 
for the Signal Corps of the U. S. Army. The course opened 
on N/)vember 19, 1917, and this report is written in March, 
1918. 

The two main features in this investigation are the mental 
tests and the daily records of progress. The mental tests 
were given to the men immediately after registration for the 
course on the same evening that they were given the physical 
examination. Every applicant took both the mental and 
physical examination before entering classes. The records of 
progress were 4>btained by means of prescribed tests of re- 
ceiving speed. The instructions and copy for the tests of 
speed were prepared in the office of the Psychology Depart- 
ment and administered to all of the fourteen classes witih as 
much imiformity as possible. The receiving speed test was 
of two minutes duration, given at every meeting of the class 
and always between the first and second hours of the three- 
hour evening session. A more complete description of these 
tests and the directions for administering them are contained 
in my "Handbook for Teachers of the Telegraphic Code" 
which has been published as Bulletin No. 16 of the Federal 
Board for Vocational Education, Washington, D. C. 

I. SUBJECTS 

1. Occupations. Among the 165 students were represented 
the mechanical and electrical trades, building and steel trades, 
engineers, chemists, salesmen, bookkeepers, etc. It is of in- 
terest to note that there is no occupational differentiation in 
the ability to learn telegraphy. Hence, occupation is not suit- 
able as an index for selecting prospective telegraphers. 

110 
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2. Schooling. Here, again, we find the rather surprising fact 
that schooling is not suitable as an index of ability to learn tele- 
graphy as far as this type of group is concerned. It is quite 
likely that the factor of schooling is loaded in this group of 
students so that the brightest of the high school and (College 
graduates may have found preferred service in the army be- 
fore being drafted. If this is true, then the college, high 
school, and grammar school groups here represented are not 
comparable. At any rate, if we take our findings at face value, 
ability in telegraphy cannot be predicted on the basis of gen- 
eral schooling. 

The Pearson correlation coefficient between number of 
years of schooling and receiving speed in telegraphy after one 
hundred hours of practice is 0.00 ±0.08; (n=158). While the 
correlation coefficient is low, it may be significant that the 
eleven students who left school before finishing the eight 
grades were conspicuously low in telegraphy. 

3. Age. Being a group of drafted men the age limits were 
21 to 31 years. The frequencies for the higher ages within 
the draft limits are relatively low. This is explained by the 
greater frequency of married men at those ages and by other 
causes of exemption among the older of the men of draft age. 
It is not without interest to note that the older men exhibited 
more perseverance in staying by the rather monotonous even- 
ing buzzer practice than the younger men. 

The correlation between age and receiving speed in tele- 
graphy after three months practice (about 100 hours) is 
— 0.09 ±0.08, which indicates that age has no diagnostic value 
in predicting ability in telegraphy within the age limits of 
21 and 31. 

II. THE MENTAL TESTS 

All of the students who entered the radio course during 
November and December took a psychological examination 
consisting of eight mental tests. The purpose of these tests 
was to ascertain whether mental tests could be used to pre- 
dict ability to learn telegraphy. 

We gave the following tests: 

1) Rhythm Test 

2) Opposites Test 

3) Analogies Test 

4) Gordon Directions Test 

5) Trabue Completion Test 

6) Spelling Test 

7) Arithmetic Test 

8) Sentence Test 
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All of these mental tests have been checked up with the 
highest receiving speed attained during the first one hundred 
hours of practice. 

1. Rhythm Test, This test was designed specially for the 
purpose of testing ability in telegraphy. It is given as follows : 
The examiner is equipped with a buzzer and telegraphic key. 
The examiner sounds on the buzzer a rhythm pattern consist- 
ing of auditory dots and dashes. Each pattern is repeated 
once in order to give all students a fair chance to hear it. They 
then reproduce the pattern, using a short horizontal line for 
a dash and a short vertical line for a dot. The test consists 
of thirty-five of these rhythm patterns given in the order of 
difficulty, beginning with the easiest. The score in the rhythm 
test is the number of errors made. The rate of presentation 
is such as would correspond to a telegraphic sending speed 
of ten words per minute and the wl*Dle test is given in about 
fifteen minutes. 

The rhythm test gives a correlation of +0.48-f|0.06. Of the 
highest thirteen students in this test, only one did worse than 
the average in telegraphy. Of the lowest fifteen students in 
this test, only three students attained the average of the class, 

2. Opposites Test, This is a good test for predicting ability 
in telegraphy. The correlation coefficient for speed in receiv- 
ing telegraphic code and scores in the Opposites Test is 
+.42 ±0.04. 

The ten radio students who rank lozvest in the Opposites. 
Test. are all inferior in telegraphy. Not one of them attained 
even average performance in telegraphy. Their average re- 
ceiving speed is 3.8 words per minute as compared with 6.4 
words per minute for the whole group. 

The lowest twenty per cent of the group (23 students), 
arranged according to the Opposites Test, have an average 
receiving speed of 4.5 words per minute as compared with 
6.4 for the whole group. Of these 23 students, only five ex- 
ceeded the average of the group in telegraphy. 

3. Analogies Test, The Pearson correlation coefficient for 
receiving speed in telegraphy and the Analogies Test is 
+0.29 ±0.05. 

Analyzing the scatter diagram more closely, we find that 
of the seventeen students who constitute the lozvest ten per cent 
of the group, according to the Analogies Test, only one student 
attained the average of the class in telegraphy. The average 
speed in telegraphy for these seventeen students is 5.2 after 
.one hundred hours of practice. The average speed in teleg- 
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raphy for the upper ten per cent of the group, divided accord- 
ing to the Analogies Test, is 7.5 words per minute after one 
hundred hours of practice. The average speed in telegraphy for 
the whole group at the same stage of practice was 6.4 words 
per minute. 

This indicates clearly that while the Analogies Test does 
not give a high correlation coefficient it can be used to elimi- 
nate a considerable portion of those who lack the special 
ability to learn telegraphy. The average telegraphic speed for 
the lowest half of the group, divided according to the Analo- 
gies Test, is 5.4 words per minute, the speed for the upper 
half of the group is 7.1 words per minute. 

If the lowest twenty per cent of the group had been elimi- 
nated on the basis of the Analogies Test the average speed 
in telegraphy would have been 7.0 words per minute instead 
of 6.4 words per minute. 

4. Gordon Directions Test, The correlation of this test with 
speed in telegraphy after one hundred hours of practice is 
+0.27 ±0.05. It has diagnostic value for ability in telegraphy 
for the lowest ten per cent of the group arranged according 
to the test, but not for the middle and higher scores in the 
test. Of the 33 radio students who scored in the lowest twenty 
per cent of the group, only four succeeded in attaining the 
average of the class in telegraphy. The average receiving 
speed for this lowest twenty per cent of the group, divided ac- 
cording Ho the test, was 4.6 words per minute, the average for 
the whole group was 6.4 words per minute. If those regis- 
trants who scored in the lowest twenty per cent of the group 
had been eliminated at the start the average receiving speed 
for the class would have been raised from 6.4 words per 
minute to 6.9 words per minute. 

If those radio students who were in the lowest half of the 
group according to the Directions Test had been eliminated 
the average receiving speed of the class after 100 hours of in- 
structions would have been raised from 6.4 words per minute 
to 8.1 words per minute. 

The two most important facts about the use of the Direc- 
tions Test for selecting telegraphers are as follows : 

( 1 ) If we consider all those students as failures who did not 
exceed three words per minute in receiving tests after 100 
hours of practice, the test would enable us to exclude 48 per 
cent of these failures; (2) only 12 per cent of those who score 
below 40 in the test succeed in doing better than the average 
of the class. 
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5. Trabue Completion Test, We used the Bureau of Sales- 
manship form of this test. It gives a correlation with teleg- 
ra^y of +0.21 ± 0.05. Of the thirteen lowest students in this 
test, four students attained the average of the class in teleg- 
r^hy. Of the eleven highest students in this test, Kmly two 
were below the average in telegraphy. While this test is not 
without some diagnostic value for ability in telegraphy its 
best use is as a supplement to other more successful tests. This 
test is usually a good index of general intelligence, but in ttie 
present investigation our criterion is ability in telegraphy 
which is a special ability and that probably accounts for the 
rather low rank of the oompletion test. 

6. Spelling Test. This test was given to the radio students 
in the belief that ability in spelling might prove to be of diag- 
nostic value in the selection of telegraphers. The correlation 
between speed in telegraphy and score in the spelling test is 
+0.18 ±0.06. 

Although this coefficient is lower than one would expect, the 
spelling test can be used effectively for eliminating some fail- 
ures in telegraphy. Of the 12 students who made the lowest 
scores in spelling, only two attained the average of the class in 
' telegraphy. The average speed in telegraphy for these twelve 
students was 4.8 words per minute as compared with 6.4 words 
per minute for the whole group. 

7. Arithmetic Test. The correlation of this test with speed 
in telegraphy is only +0.08 ±0.05. Inspection of the scatter 
diagram shows that this test has no diagnostic value for ability 
in telegraphy. 

8. Sentence Test. This test gives a correlation with teleg- 
raphy of +0.09 ± 0.05, which indicates that the test has no 
diagnostic value for ability in telegraphy. 

III. SUMMARY 

(1) Figure 1 shows in black the speed in telegraphy of 
those who failed in any two or more of seven tests. The seven 
tests here considered are: Rhythm, Opposites, Analogies, 
Directions, Sentence Completion, Spelling, Number Comple- 
tion. The white spaces indicate the telegraph speed pi those 
who did not fail in more than one test. 

(2) Figure 2 shows the scatter diagram for the Rh)rthm 
Test with a Pearson correlation coefficient of +0.48 ±0.06. 
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(3) Five of the tests have been evaluated by the method of 
multiple correlation: These tests were: Rhythm, Opposites, 
Completion, Analogies, and Gordon Directions. The fourth 
order coefficients for these tests with telegraphic receiving 
speed after one hundred hours of practice as the criterion are 
as follows : 

Rhythm: ''12 (3456)=H"-31 
Opposites : '13 (2456)=+ .21 
Completion : 'h (2366)=+ .096 
Analogies : ' 15 (2346)=f .02 
Gordon Directions : 'le (2346)=+ .06 

(4) The general intelligence tests are not as valuable for 
diagnosing ability to learn telegraphy as for measuring gen- 
eral intelligence. Ability in telegraphy is probably a special 
ability. 

(5) The fact that years of schooling does not agree with 
ability to learn telegraphy indicates that this is a special 
ability. College graduates usually do better on general intel- 
ligence tests than those who have only finished grammar 
school. But college graduates do not necessarily excel in 
learning telegraphy. 

(6) The total correlation coefficient ^i(n4is) for receiv- 
ing speed in telegraphy on the one hand and the combined 
score in five tests is +.53 ± 0.04. The Rhythm Test alone gives 
a zero order coefficient of .48 which is not noticeably raised by 
the addition of four of our best general intelligence tests. 
Hence the Rhythm Test carries most of the load. 

(7) The bimodality of figure 1 is probably significant and 
indicates that we are here dealing with a special ability. The 
upper mode probably represents that part of the group of sub- 
jects in which the special ability is present. 

(8) A vocational survey of students in a radio mechanics 
course shows that schooling is one of the best diagnostic 
criteria in selecting men to be trained in the care and repair of 
wireless apparatus but our analysis also shows that when 
selecting men to be trained as telegraph operators the school- 
ing is of no diagnostic value. 
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AN ABSOLUTE INTELLIGENCE SCALE: A STUDY 
IN METHOD 



By Grace Arthur and Herbert Woodrow, University of Minnesota 



Aim: The present investigation^ is a study of a series of 
group tests as regards their value, — 

(1) in classifying children of grade school age according 
to mental ability ; 

(2) in the construction of a scale of absolute intelligence 
units ; 

(3) in comparing the "more or less" with the "all or 
none" method of scoring; and 

(4) in a system of weighting, which is neither arbitrary 
nor determined by subjective evaluation qf the tests used, but 
which is logical in its origin and automatic in its application. 

The aims of this investigation need but little explanation. 
The need for group intelligence tests has long been recognized 
and several systems of such have made their appearance since 
the present investigation was undertaken. Our interest, how- 
ever, is not primarily in the development of group tests, but 
in certain fundamental features of method, of the same im- 
portance in individual testing as in group testing. The feature 
in which we are mainly interested is the use of absolute intelli- 
gence units, — units, that is, which are equal at all points of 
the scale and in terms of which it is possible to plot an abso- 
lute intelligence curve showing (in so far as the tests used 
really measure intelligence) the absolute increase in intelli- 
gence of children with increase in chronological age. 

In the selection of tests, we have chosen only such as permit 
a measurement of degree in the ability tested, whatever that 
degree of ability may be. Such tests offer a marked contrast 
with the Binet-Simon tests. Many of the latter determine 
merely whether or not a certain degree of ability is exceeded, 
instead of measuring by how much it is exceeded or by how 

1 It is with pleasure that acknowledgment is made to Dr. Frances 
Lowell, of the University of Minnesota for suggestions as to the choice 
of tests and details of procedure, and to Miss Edith Taylor, principal 
of the Hancock School (the school tested), St Paul, Minn., for her 
aid in securing a favorable attitude towards the tests on the part of 
teachers and pupils. 
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much it fails of being reached. Such tests, the child either 
fails or passes. They may be termed " all or none " tests. In 
contradistinction to them, the tests here employed may be 
called " more or less " tests, because they measure the ability 
which they test in any amount from zero up to the maximum. 

When scored by the more or less method, different tests, 
such as must be used in any measurement of intelligence, give 
measures in different units. It becomes an important prob- 
lem, consequently, how to average together the results of the 
different tests. A common method of combining the results 
of several tests is to weight them, but the methods of weighting 
heretofore used appear unsatisfactory, — and even, in some 
conspicuous cases, entirely arbitrary. We have found, how- 
ever, that by using absolute intelligence units of the sort men- 
tioned, weighting of the different tests occurs logically and 
automatically, and in exact correspondence to their value in 
discriminating between children of different age and, there- 
fore, presumably of different intelligence.* 

Choice of Tests: As the tests were to be given to all the 
pupils of a grade school, it was necessary to select such as 
would be simple enough for the younger children to compre- 
hend, and at the same time difficult enough to tax the ability 
of the most mature. The tests finally decided upon were the 
following : 

Immediate Memory Span (digits) 

Easy Opposites (new lists bs^ed on the data obtained 

by King and Gold)' 
Hard Opposites 

Substitution (Woodworth — ^Wells) 
Word Building (a, e, i, r, I, p, and a, e, o, b, m, t) 
Language Completion (Trabue, Scales B and L) 
Anagrams (original) 
Cancellation (three letter) 
Comprehension (adapted from Kuhlmann) 

The only ones of these tests requiring special description 
are the anagrams test and the comprehension test. The ana- 
grams test consisted of twenty-one words, varying in length 
from three to seven letters, taJcen from the lower end of the 
Ayres' spelling scale. A definite scheme of letter displace- 

* It hardlv needs to be pointed out here that the only natural intel- 
ligence scale by which the validity of psychological scales can be 
checked is that formed by the chronological age groups. 

•The Standardization of Certain Opposites Tests. Journal of 
Educational Psychology, 1916, p. 459. 
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ment was followed and the words were arranged in order of 
difficulty estimated from their relative length and the number 
of letters displaced. This trial list was given to the pupils of 
the first, second, sixth and eighth grades of another school, 
and the words were then arranged in increasing order of diffi- 
culty as shown by a frequency table based upon the responses 
of these pupils. Spelling ability, as a factor of success in this 
test, was reduced to a minimum by using only the easiest 
words from the Ayres' list. To offset the puzzle element as 
much as possible, the subjects were instructed, in case they 
came to a word they could not get, to go on to the next and 
to come back to the hard word later. 

For the comprehension test, three of the best individual 
tests from the Kuhlmann 1917 revision* were combined and 
adapted for group work. Two test sheets were used, the 
easier for all grades, the harder for the 4th to the 8th grades 
inclusive. Where results from both forms were used, they 
were added to give the total score. 

Subjects: The subjects were grade school pupils from 6 
to 17 years of age, inclusive. Norms for the separate tests 
were secured for the ages 6 to 13 years (though the system 
of tests here employed is not regarded as adapted to children 
under 7 years). Results for the age g^ups above 13 were 
discarded, because all the members of these groups were re- 
tarded pedagogically. Eleven subjects of the 13 year group 
were one-half to one year advanced pedagogically, and as they 
entered high school before the testing was completed, they 
had to be rejected from the cases finally used. From an ex- 
amination of the age and grade distribution of the school, it 
would appear that the 10 year group had fewer bright sub- 
jects than had the other age groups. It is probable, therefore, 
that the 10 years norms, as well as the 13 year norms, are too 
low. This is of little concern to us in the present stage of 
our investigation,* as we believe we can improve on the selec- 
tion of tests used and expect to obtain new norms. 

For all subjects, chronological ages were reckoned to March 
8th, 1918, as that date would give an error of less than one 
month in the great majority of the cases. 

Instructions: Written instructions were used by the experi- 
menter for all the tests, and were half spoken, half read. For 
the most part, the instructions were adaptations of those of 

* Kuhlmann, The Measurement of Mental Development. Journ. of 
Psycho- Asthenics, Monog. Sup., 191 7. 

' This work was interrupted by the entrance of one of the writers 
into military service, but will be continued by the other. 
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earlier investigators. They were given a preliminary trial 
with first, second, sixth and eighth grade groups of another 
school, and were then revised on the basis of the results with 
these groups. 

In giving instructions, group response in a trial test was 
secured wherever possible. Purity of diction was sacrificed 
in every case where a colloquial form appeared to be more 
readily understood. We spare the reader details of the tests 
and instructions, hoping to present them at a future time when 
our scale of mental measurement is more perfectly standard- 
ized. 

Norms: With each age group, the mean, as the most prob- 
able true value, was taken as the norm. The mean was found 
to increase from one age to the next for all tests except the 
cancellation test, for which the 9 and 10 year scores are iden- 
tical. It is impossible to make any direct comparison between 
our norms and those of other investigators, on account of 
differences in the form of the tests or the method of giving 
them. 

The norms obtained for each of the nine tests is given in 
Table I, in the lines marked Av. Immediately below each 
norm, that is, below the average score of each age group, is 
given the corresponding standard deviation (<r). Our pur- 
poses would probably be served by any other measure of 
variability about as well as by the standard deviation. At the 
top of Table I, are given the ages of the children and the 
number (No.) at each age. By age 6.5 is meant all ages from 
6 yrs. ms. to 6 yrs. 11 ms. inclusive; similarly for all other 
ages. 

Point Scale Norms for Individual Tests: To deal with the 
data effectively, it is of course necessary to reduce the norms 
found for the different tests to comparable units. These units 
should not only be comparable, but should also be of such a 
nature that the test which has the highest discriminative value 
will have its norms represented by the largest number of units, 
so that, in summing up the total number of units, or points, 
scored by a child in all tests, the different tests will have 
weight directly in proportion to their discriminative value. 

The discriminative value of a test consists in its capacity 
for bringing out individual differences in intelligence. This 
value is low when the scores of children of one age group 
largely overlap those of adjacent age groups; and it is high 
when there is little overlapping. Now the amount of over- 
lapping in the scores of two adjacent age groups depends upon 
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two factors: first, the difference in the average score of the 
two groups, and second, the variability within those groups. 

That the amount of overlapping will vary with difference in 
the average scores may be readily appreciated. If there is no 
difference between the average scores of two groups, their 
scores will substantially coincide, in fact exactly so, except for 
difference in the form of distribution of the scores. In such a 
case, if 50 per cent of one of the groups exceeds its own 









TABLE I 
Norms 


" 










Tests. 


^ 


6.5 
66 


7.5 
87 


8.5 
82 


9.5 
83 


10.5 
98 


11.5 
95 


12.5 
87 


13.5 
71 


Easy Oppo- 
sites 


Av. 


0.0 

0.0 


1.1 

1.2 


2.6 
1-5 


4.4 

2^5 


5.2 

2.1 


6.5 
1-9 


7.4 

2.1 


8.6 

2.6 


Hard Oppo- 
sites 


Av. 

9 


0.0 

0,0 


0.5 

1.0 


1.3 
1-5 


2.8 
3-0 


3.7 
3-1 


6.3 

4 4 


7.1 
4-1 


9.1 
4-5 


Substitution 


Av. 


10.1 

6.2 


20.5 
11. 1 


30.2 
"5 


40.3 

12.0 


44.2 
/-?.5 


50.6 

J J. .2 


52.3 
10.7 


59.1 


Word Build- 
ing 


Av. 

9 


0.4 
o.g 


2.3 

2 5 


4.3 

2.S 


6.3 
3-4 


7.4 
J. 2 


9.8 


10.3 
J. 7 


12.0 
50 


Digits' Span. 


Av. 


3.0 
1-5 


4.4 

0.5 


4.9 
0.7 


5.3 

0.8 


5.4 
0.8 


5.7 

0.8 


5.9 

0.8 


6.0 

1.0 


"-^Wetim 


Av. 


1.7 

2.2 


5.0 

3-0 


7.5 
3-1 


10.3 
4-4 


11.4 


14.2 
47 


15.0 
J.* 


15.1 
44 


Anagrams 


Av. 

9 


1.8 

2.2 


4.5 
5-5 


7.4 
J.' 


9.1 
3-1 


9.2 

3-2 


10.2 

2.8 


11.1 

2.8 


11.7 
3-4 


Cancellation 


Av. 

9 


12.1 

5.2 


16.0 
4-7 


17.2 
3-9 


20.6 
5.0 


20.6 
4.p 


23.0 
5.x 


23.7 
5 7 


25.6 
5.<^ 


Comprehen- 
sion 


Av. 

9 


2.5 

2 5 


4.0 

2.0 


5.8 
3-9 


9.5 
d.2 


13.1 
5.J 


16.1 


16.8 
J.J 


17.2 

2.p 



average, we may reasonably expect that substantially 50 per 
cent of the other will also exceed that average. On the other 
hand, if there is a great difference between the average scores 
of the two adjacent groups, there will be little overlapping, 
and if 50 per cent of both groups exceed their group average, 
a very high percentage, well over 50, of the older group will 
exceed the average of the younger group. Obviously, if tlie 
variability is the same, the greater the difference in the per- 
centage of the two groups exceeding a fixed degree of ability, 
the less the two groups will overlap. In general, with a fixed 
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variability, the amount of overlapping varies with the differ- 
ence between the averages lOf the two groups. This diflference 
between adjacent averages, then, is one factor determining the 
discriminative value of the test. 

Equally important is the factor of variability. With a fixed 
difference between the two averages, the amoimt of overlapping 
between the two groups depends upon their variability. We 
may have, for example, a difference of five units between the 
two averages, and have either no overlapping or a high degree 
of overlapping, depending upon whether the children of each 
group are distributed closely about their own average or spread 
out over a wide range. If the variability is small, we may 
find that 100 per cent of the older group exceeds the median 
performance of the younger; if large, that less than 60 per 
cent of the older exceeds the median of the younger. As a 
measure of the variability of any two adjoining age groups, we 
have used the average of the standard deviations of those two 
groups. 

To find the discriminative value of any test, then, between 
two adjoining age groups, it is necessary to compare the dif- 
ference between the average scores of the two groups with 
the average of their standard deviations. The larger the 
ratio of the former to the latter, the greater will be the dis- 
criminative value. Accordingly we may write, as the formula 
for calculating discriminative value. 



D.V.= 



Avi — Avi 



K (<ri + <rO 



in which D, V, stands for discriminative value, Av, and<r,, 
respectively for the average and standard deviation of the 
older group and Avj and<r„ for the same of the younger group. 
While the above flormula is the one we have used in calculat- 
ing the discriminative values of our tests, it may aid in under- 
standing their nature to point out that they may be calculated 
in other ways. This is possible because of the relationship 
between the standard deviation and the percentage of children 
exceeding any given deviation from the average. On account 
of this relationship, discriminative value may be calculated 
from the percentage of children of one age who pass the 
average score of those of the next higher age; or from the 
percentage of the higher age failing to pass the average of the 
next lower age; or, lastly, from the average of these two 
percentages. Still another way to put the matter, is to say that 
discriminative value depends upon the increase with age in 
the percentage passing a given score. 
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One way, then, to calculate the discriminative value of a 
test between two adjacent age groups would be on the basis 
of the average of two percentages, one, that of the lower group 
exceeding the average of the higher, the other, that of the 
higher failing to reach the average of the lower. If the 
average of these two percentages happened, for example, to 
be 15.86, then we could conclude that the difference between 
the two group averages just equalled the average of the 
standard deviations. This would mean, according to our 
formula, that the discriminative value of the test in question 
was 1.0. If the average of the two percentages was anything 
else than 15.86, we would simply look up the fraction of the 
standard deviation to which it corresponds. For example, if 
it was 10, the value of the test in discriminating between the 
two groups would be 1.28; if it was 35, the discriminative 
value would be only 0.39.* 

Again, if we have as data the fact that 75 per cent of the 
higher group exceed the average for the lower group, then we 
can, by the use of published tables,^ read off directly the value 
of the test in discriminating between the two groups. In the 
instance given, the discriminative value would be 0.67. 

Now it is well known that the percentage of one age group 
passing the norms of the age group one year younger tends 
in general to decrease as we reach the higher chronological 
ages. We should expect, then, that the discriminative values 
of our tests would show a tendency to decrease at the higher 
chronological ages. As a matter of fact, they do so. 

Before leaving the subject of the relation between discrimi- 
native value and the percentage of one age group passing the 
norms of the preceding age group, it is of interest to consider 
one conclusion generally conceded to follow from the varia- 
tion in this percentage. At the higher chronological ages, as 
already stated, the percentage of any year group passing the 
norms of the one year younger group is usually less than at 
the lower chronological ages. This fact, it is commonly rec- 
ognized,^ means that the absolute difference between the men- 
tal ages of two groups differing by one year is less at the 
upper chronological ages than at the lower, — that a year of 
mental age is a smaller unit at the upper ages than at th^e 

« See Thorndike, Mental and Social Measurements, 1904, p. 148. 

T Thorndike, loc. cit., or W. F. Sheppard, Biometrika, 1903, Vol. II, 
p. 182. 

« Kuhlmann, Some Results of Examining a Thousand Public School 
Children with a Revision of the Binet-Simon Tests of Intelligence by 
Untrained Examiners. Journ, of Psycho-Asthenics, Vol. XVIII, 1914, 
p. 235. 
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lower. As Kuhlmann puts it, " the amount of mental devel- 
opment during a year cannot be taken as an accurate unit of 
measurement of intelligence."' Mental age is not an absolute 
unit, but a changing unit. The present method subscribes to 
this point of view. In fact, it might be summarized as an 
attempt to find, for the different ages, norms which correspond 
in magnitude to the actual absolute increase in intelligence 
with age. 

In the present work, the discriminative value of a test as 
derived from the formula Av, — Av,/>^ (<ri+<ri), has been 
used in preference to that based upon the obtained per cents 
of one age group falling above or below the norms of adja- 
cent groups. The discriminative values when based upon the 
standard deviations, as in the formula we have used, are based 
upon the data for the entire group instead of for portions 
lying towards the extremes. We have worked through all our 
data, however, by both methods, and found that in the great 
majority of instances the results derived by the two methods 
are so nearly identical as to make it feasible to use whichever 
is the more convenient. In further work, therefore, while 
norms are shifting, in order to avoid the labor of calculating 
the standard deviation anew every time new cases are added, 
it will probably be advisable to use discriminative values based 
upon the per cents of the various age groups passing the aver- 
age of the next higher group and failing to pass the average 
of the next lower group. 

The discriminative values may be treated as " points " or 
units. Thus, if the discriminative value of a given test be- 
tween the ages 6.5 and 7.5 is 1.4 units, we consider that the 
7.5 year group shows an increase of 1.4 units over the 6.5 
year group in the ability tested. We do not, of course, know 
how many units of ability the 6.5 year group possesses, as we 
did not extend our testing down to the age of zero, whatever 
that may be. Taking the average ability of the 6.5 year group 
as X, however, we may say that the 7.5 year group shows 
x+\A units of ability. Similarly, the quotient representing 
the value of the test in discriminating between the 7.5 year 
group and the 8.5 year group indicates the value to be added 
to the 7.5 year average of ability. Thus, if the discriminative 
value of the test for the age groups 7.5 and 8.5 is 1.1 units, 
then we can represent the average 7.5 year ability as jr + 1.4 
units, and the average 8.5 year ability as jir+1.4+1.1, or 
X + 2.S units. By continuing this process through all age 
groups, the original norms are readily changed to norms in 
terms of points. 

• Loc cit. 
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In the case of tests of high discriminative value, more points 
are added for each year, and the norms thus come to be ex- 
pressed as a larger number of units than in the case of tests 
of low discriminative value. Because of the different rate of 
increase in points or units from age to age in the different 
tests, it results that when we add together the scores for all 
tests to obtain the final scale, there is an automatic weighting 
in favor of the more valuable tests. This may be dearly seen, 
by a comparison of the point scale for easy opposites with 
that for cancellation. The subject who just equals the 13.5 
year norm in easy opposites will secure x + 4.9 points, while 
the subject who equals the 13.5 year norm in the three letter 
cancellation test will earn only x + 2.8 points. This weighting 
is not done arbitrarily or by any uncertain subjective estimate ; 
nor is it done simply because the opposites test is regarded as 
a good test and the cancellation a bad one ; it is done because 
the former, by exhibiting at all ages a higher degree of dis- 
criminative capacity than the latter, has secured at each age a 
larger number of points for its norms. How this comes about 
may be seen from the following table (No. II). 

TABLE II. 
Comparison of Point Norms of Easy Opposites with Three Letter 

Cancellation 





Easy Opposites 




Can< 


CBLLATIOS 




Age 


Original 
Norms 


V 


Discrim. 
Value 


Point 
Norms 


Original 
Norms 


9 


Discrim. 
Value 


Point 
Norms 


6.5 
7.5 



1.1 



1.2 


0.9 


X 

x-H).9 


12.1 
16.0 




0.8 


X 

x+0.8 


8.5 


2.6 


r S 


1.1 


x+2.0 


17.2 


3 9, 


0.3 


x+1.1 


9.5 


4.4 


^ s 


0.9 


x+2.9 


20.6 


^•^ 


0.8 


x+1.9 


10.5 


5.2 


2.1 


0.34 


x+3.2 


20.6 


4-9 


0.0 


x+1.9 


11.5 


6.5 


'Q 


0.65 


x+3.9 


23.0 


s-r 


0.5 


x+2.4 


12.5 


7.4 


2.1 


0.40 


x+4.3 


23.7 


S'7, 


0.1 


x+2.5 


13.5 


8.6 


2.6 


0.55 


x+4.9 


25.6 


SA 


0.3 


x+2.8 
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The increase with age in the point values of the easy oppo- 
sites and cancellation norms is shown graphically in Figure 
No. 1. This figure shows that growth in the ability tested by 
the easy opposites test is very much greater, when measured in 
absolute units, than is that in the ability tested by the can- 
cellation test, this in spite of the fact that the original score 
norms show just the reverse. The increase between seven 
and thirteen years in the number of cancellations is 13.5, 
whereas the increase in the number of easy opposites is only 
8.6; but the absolute increase in ability with age is neverthe- 
less much greater in the case of the easy opposites. 
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Figure i. — Point norms for two tests, showing weighting cflFect. Op., 
opposites test; Can., cancellation test. Chronological ages repre- 
sented by abscissae, points by ordinates. 

It might appear, at first thought, that in combining the point 
norms of the individual tests to obtain the final scale, the 
different tests are not weighted to the same extent toward the 
X end of the scale as towards the upper end. For example, 
in Figure 1, since the two curves start at the same point, it 
may be asked, are they not weighted equally at this point? 
Such a question, however, would show a misconception of 
wherein the weighting consists. 

To understand this matter, it is necessary carefully to anal- 
yze our procedure. What we do, in reality, is simply to com- 
bine (by adding their ordinates) a number of curves like those 
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in Figure 1 to obtain one final curve. Now the shape of this 
final curve is not aflfected by the height at which we place the 
individual curves. For example, if we combine the two curves 
of Figure 1 (by adding their ordinates), the shape of the 
resulting curve is the same whether the individual curves are 
plotted so as to coincide at the age of 6.5, as in the figure, or, 
on the other hand, so as to coincide at the age of 13.5. If we 
plotted all our individual curves so that they would coincide 
at the age of 13.5, then x would be the number of units of 
intelligence possessed by the average child of 13.5, and we 
would use the scale to measure the intelligence of any indi- 
vidual child in terms of the number of units below x. The; 
age at which the curves for the individual tests coincide can 
be controlled by the height at which the various curves are 
plotted ; but, no matter at what age they are made to coincide, 
the shape of the combined curve will be the same. 

We do not attempt to determine the absolute height of any 
portion of the intelligence curve. We merely attempt to plot 
a portion of it — that lying between the ages 6.5 and 13.5— in 
terms of strictly comparable units. This portion is, as it were, 
suspended in mid-air at an unknown height. If we knew its 
height, we would need no x. It does not matter, however, 
what point we take as the point whose absolute height we 
call X, for we do know the number of units of height of any 
point in the obtained portion above or below any other point 
in it. 

It should be clear, then, what weighting a test means in the 
present case. That test is weighted most whose curve tends 
most to give the combined curve a vertical direction. If. at 
certain points, it tends more strongly than at others to give 
verticality to the combined curve, it is weighted more at those 
points. On the other hand, that curve which tends most to 
make the combined curve horizontal is weighted least. With 
these considerations in mind, it will be clear that the easy 
opposites test has greater weight from one end to the other 
than the three letter cancellation test. The point-norm curve 
for easy opposites, being steeper than that for the cancellation 
test, tends more to give verticality to any combined cur\'e 
into which it enters as a component. Further, it will be 
realized that in those regions where the curve for the cancel- 
lation test runs more nearly horizontal than at others, the test 
has less weight. Thus, between the ages of 9 and 10, where 
the curve for the cancellation test runs exactly horizontal, the 
test as a test for discriminating between the mental ages nine 
and ten has a weight of zero, though it retains a not incon-* 
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siderable weight as a test for discriminating between these 
ages and those above or below them. 

One more question which may arise in connection with the 
present scale is, why it is called an absolute scale? This can 
best be understood, perhaps, by recalling the facts which cause 
it to be generally conceded that the absolute increase in mental 
age from year to year varies, tending to decrease at the upper 
ages. This generally accepted view rests primarily on the 
fact that as we reach the higher ages, the percentage of chil- 
dren of one age able to pass the same tests as the average 
child of the next younger age tends to decrease. It is easy, 
for example, to find tests passed by only 50 per cent of three 
year olds, which can yet be passed by 80 per cent of four year 
olds, whereas it is difficult to find tests passed by 50 per cent 
of thirteen year olds which are passed by even 60 per cent of 
fourteen year olds. This variation in the percentage of chil- 
dren of one age who pass the same tests as the average child 
a year younger is taken to indicate variation in the absolute 
difference between any two adjacent mental ages. 

In short, it is generally conceded that the difference in these 
percentages serves as an index to the absolute difference in 
mental ability between any two mental ages. Now the dis- 
criminative values which we have used are, as has been pointed 
out, values which correspond directly with the percentages 
mentioned ; they are the mathematical measures of that differ- 
ence between the performances of two adjacent age groups 
which determines what percentage of the upper group will ex- 
ceed the average of the lower; consequently they are the 
mathematical measure of the absolute difference between the 
age groups, and a scale of which they constitute the units is 
an absolute scale. 

The original score norms and their values in absolute intel- 
ligence units or points is given for all nine tests in Table III. 
The point values are all worked out in the way already de- 
scribed, illustrated in Table II. 

TABLE III 

Values op Original Norms When Transfchimed into Absolute 
Intelligence Units 

Av.^^untransfonned norms. Points=value in abeolute intelligence units. 

Age 6.5 7.5 8.5 9.5 10.5 11.5 12.5 13.5 

Easy Op- Av. 0.0 1.1 2.6 4.4 5.2 6.5 7.4 8.6 
podtes.. Points x 0.9 2.0 2.9 3.2 3.9 4.3 4.9 
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Hard Op- Av. 0.0 0.5 1.3 2.8 3.7 6.3 7.1 9.1 
posites.. Points x 0.5 1.1 1.8 2.1 2.8 3.0 3.4 

Substitu- Av. 10.1 20.5 30.2 40.3 44.2 50.6 52.3 59.1 
tion Points x 1.2 2.1 3.0 3.3 3.8 4.0 4.6 

Word Av. 0.4 2.3 4.3 6.3 7.4 9.8 10.3 12.0 

Building. Points x 1.1 1.9 2.5 2.8 3.5 3.6 4.1 

Digits' Av. 3.0 4.8 4.9 5.3 5.4 5.7 5.9 6.0 

Span... Points x 1.2 1.9 2.4 2.6 3.0 3.2 3.3 

Language Av. 1.7 5.0 7.5 10.3 11.4 14.2 15.0 15.1 

Completion Pdints x 1.3 2.1 2.9 3.2 3.9 4.6 4.1 

Anagrams. Av. 1.8 4.5 7.4 9.1 9.2 10.2 11.1 11.7 

Points X 0.9 1.8 2.3 2.3 2.7 3.0 3.2 

Cancel- Av. 12.1 16.0 17.2 20.6 20.6 23.0 23.7 25.6 

lation... Pdints x 0.8 1.1 1.9 1.9 2.4 2.5 2.8 

Compre- Av. 2.5 4.0 5.8 9.5 13.1 16.1 16.8 17.2 
henaon.. Points x 0.7 1.3 2.0 2.6 3.3 3.5 3.6 

Total X 8.6 15.3 21.7 24.« 29.3 31.2 34. • 

(i. e., absolute intelligence scale.) 

Point Values for any Possible Score: After the number of 
points corresponding to each age norm, as shown in Table III, 
had been worked out, the next step was to work out the num- 
ber of points corresponding to any possible score. This was 
done by the same formula as that used in finding the number 
of points corresponding to the norms. The difference between 
a given possible score and the next lower norm was divided 
by the average of the standard deviations of the two norms 
between which the score in question occurred. The result, 
added to the number of points corresponding to the next lower 
norm, gives the point value of the score in question. Points 
were assigned in this way for every possible score lying be- 
tween the norms for 6.5 yrs. and 13.5 yrs. inclusive. 

As we had no norms beyond these age limits, the problem of 
how to deal with scores falling beyond the norms for these 
ages was a difficult one. It was finally decided to reckon the 
number of points below x corresponding to any score below 
the average of the 6.5 year group in terms of the standard 
deviation of that group ; and, similarly, to reckon the number 
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of points above the 13.5 year point norm corresponding to 
any score above the 13.5 year average in terms of the standard 
deviation of the 13.5 year group. Deviations below the 6.5 
year norm, then, were transformed into points by dividing 
them by the standard deviation of the 6.5 year group, while 
deviations above the 13.5 year norm were divided by the 
standard deviation for that age group and the resulting num- 
ber of points was added to the number of points corresponding 
to the 13.5 year norm. Since x, or arbitrary zero, is placed at 
the 6.5 year average, the point values of scores below x are 
negative. They were worked out for each test down to the 
point value of a performance score of zero. 

This procedure used in calculating the point values of scores 
lying above our highest norm, or below our lowest, differs 
from the procedure used elsewhere in the scale in that else- 
where the diflFerences are divided by the average of two stand- 
ard deviations, namely, the standard deviations of the norms 
both below and above the score in question. Since we have 
no norms, or averages, below 6.5 or above 13.5, it is necessary 
with scores respectively below and above these points to use 
as a divisor simply one standard deviation, — that of the 6.5 
year group for scores below the 6.5 year norm and that of the 
13.5 group for scores above the 13.5 year norm. Such a pro- 
cedure involves the assumption that the 6.5 year standard 
deviation applies to all scores below the 6.5 year norm, and 
the 13.5 year standard deviation to all scores above the 13.5 
year norm. There is an element of error in this assumption, 
as standard deviations tend to vary with age. It is possible 
therefore, that by using the 6.5 year standard deviation, we 
have penalized failure to reach the 6.5 year norm less severely 
than if the correct standard deviations of the lower age groups 
could be taken into consideration. For scores above the 13.5 
year norm, however, it is not likely that there is any ap- 
preciable error involved, since the standard deviations tend not 
to change much after the 13th year. 

We thus worked out a table of nine columns, giving the 
number of points to be assigned to any possible score in each 
of the nine tests. Four of these columns are given by way of 
illustration, in the accompanying table. No. IV. Scores lying 
outside of the horizontal lines lie outside of the obtained age 
norms, and were calculated as explained in the preceding 
paragraphs. 



Digitized by 



Google 



132 



ARTHUR AND WOODROW 

TABLE IV 
Point Values for Any Possible Score 



Hard Oppootes 


language 

Completion 


Comprehension 


Anagrams 


Score 


P^ts 


Score 


Points 


Score 


Points 


Score 


Points 





X 





—0.8 





—0.8 





-0.8 


1 


0.9 


1 


—0.3 


1 


—0.6 


1 


—0.4 


2 


1.5 
1.9 


2 
3 


0.1 
0.5 


2 


-0.2 


2 
3 


o.i 


3 


3 


0.2 


0.4 


4 


2.1 


4 


0.9 


4 


0.7 


4 


0.8 


5 


2.4 


5 


1.3 


5 


1.0 


5 


1.1 


6 


2.7 


6 


1.6 


6 


1.3 


6 


1.4 


7 


3.0 


7 


1.9 


7 


1.5 


7 


1.7 


8 


3.2 


8 


2.2 


8 


1.7 


8 


2.0 


9 


3.4 


9 
10 


2.5 
2.8 


9 
10 


1.9 
2.1 


9 
10 


2.3 


10 


3.6 


2.6 


11 


3.8 


11 


3.1 


11 


2.3 


11 


3.0 


12 


4.0 


12 


3.3 


12 


2.4 


12 


3 3 


13 


4.2 


13 


3.6 


13 


2.6 


13 


3.6 


14 


4.4 


14 


3.8 


14 


2.8 


14 


3.9 


15 


4.6 
4.8 


15 


4.1 


15 
16 


3.0 
3.2 


15 
16 


4.2 


16 


16 


4.3 


4.5 


17 


5.0 
5.2 


17 
18 


4.5 

4.7 


17 


3.6 


17 
18 


4.8 


18 


18 


3.9 


5.1 


19 


5.4 


19 


4.9 


19 


4.2 


19 


5.4 


20 


5.6 


20 


5.1 


20 


4.5 


20 


5.7 






21 


5.3 


21 


4.8 


21 


6.0 






22 


5.5 


22 


5.1 










23 


5.7 


23 


5.4 










24 


5.9 














25 


6.1 














26 


6.3 











Absolute Intelligence Scale: The quotients which we have 
termed discriminative values represent an absolute increase in 
ability from one age to the next, for their respective tests. 
If the nine tests used can be regarded as tests of intelligence, 
then a scale built up from an amalgamation of the results of 
all nine may properly be regarded as a scale of absolute in- 
crease in intelligence (beyond a starting point, x, arbitrarily 
taken as the norm for 6.5 yr. old children). The final absolute 
intelligence scale is thus secured simply by adding together the 
point scales of the individual tests. The normal absolute in- 
telligence score for any age is simply the sum of the normal 
point scores for that age of all nine tests. This has already 
been given in Table III (bottom line). 

The absolute intelligence scale represents the normal growth 
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in absolute intelligence from the age of 6.5 to 13.5 years. We 
have plotted this scale as an intelligence growth curve, in 
Figure 2. It will be observed that the curve brings out the 
fact that growth in intelligence is considerably more rapid in 
the earlier years than in the later ones. It looks as if, were it 
continued at the upper end, it might reach a level somewhere 
in the neighborhood of 16 or 17 years, and, on the other hand, 
if continued at the lower end, become much steeper at the first 
few years of life. 




Figure 2. — Curve showing growth in intelligence, measured in j.l)solute 
units, between the ages 6.5 and 13.5. Ages arc represented by ab- 
scissae, absolute intelligence units by ordinates. 

As already stated, to determine the total point score for 
each age, the points corresponding to the norms of each age 
group for the nine tests were added together. Norms for 
months were then interpolated between these year norms. The 
final scale, showing the nimiber of absolute intelligence units 
corresponding to each age, from 6.5 years to 13.5 years, in- 
clusive, by months, is given in Table V. 

TABLE V 

Number of Absolute Intklligbncb Units Corresponding to Each Month 
or Age from 6.5 Years to 13.5 Years 
Omo. Imo. 2 mo. 3 mo. 4 mo. 5 mo. 6 mo. 7 mo .8 mo. 9 mo. lOmo. llmo- 

6yi» X .7 1.4 2.2 2.9 3.5 

7yrt 4.3 5.0 5.8 6.5 7.2 7.9 8.6 9.2 9.7 10.3 10.8 11.4 

Syn 12.0 12.5 13.1 13.6 14.2 14.8 15.3 15.8 16.4 16.9 17.4 18.0 

9yTB 18.5 19.0 19.5 20.120.6 21.121.7 21.9 22.122.3 22.5 22.7 

lOyn 22.8 23.0 23.2 23.4 23.6 23.8 24.0 24.4 24.9 25.3 25.8 26.2 

llyrs 26.6 27.127.5 28.0 28.4 28.8 29.3 29.5 29.6 29.8 29.9 30.1 

12yTB 30.3 30.4 30.6 30.7 30.9 31.1 31.2 31.4 31.7 31.9 32.1 32.4 

ISyrs 32.6 32.8 33.0 33.3 33.5 33.7 34.0 
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By the aid of Table V, mental ages may be determined and 
intelligence quotients may then be reckoned in the usual man- 
ner. The procedure involved, then, in measuring the intel- 
ligence of any member of a group of children, by the present 
method, is as follows : First, the original scores in each of the 
nine tests is determined. By the use of a nine column table 
these original scores are changed to point scores. The sum 
of these nine point scores is the number of units of intelligence 
credited the child. This number of units can be immediately 
transformed into mental age by the use of Table V. 

Results of Application of the Scale: Measurements of the 
absolute intelligence above the average for 6.5 years were 
secured for 490 pupils. These measurements were then con- 
verted, by the use of Table V, into terms of mental age and 
intelligence quotient. It is usually held that the first criterion 
of the reliability of any scale for the measurement of children's 
intelligence is that the median child of each age group should be 
found to have a mental age just equal to his chronological age. 
Now our norms are based on averages and not on medians, and 
it is fairly clear that the average mental age of our various 
chronological age groups nms higher than their median. For 
most of our groups, however, it is impossible to determine the 
exact average mental age, for in many cases our only informa- 
tion is that the mental age is over 13.5 or less than 6.5. Con- 
sequently, in place of a table comparing average chronological 
ages with average mental ages, such as we should prefer to 
give, we must be content with the usual comparison of median 
ages. By the aid of Table VI, it may be seen how closely the 

TABLE VI 

Median Mental Age for Each Age Group 

Chronological Age of Median Chronological Median Mental Agt 
Group Age 



7.5yr8. 


7yr8.6.5ni08. 


7yrs. 4.5 mo8. 


8.5 " 


8 " 6.75 " 


8 " 4.6 " 


9.5 " 


9 " 5.4 " 


9 " 3.2 " 


10.5 " 


10 " 6.4 " 


10 " 4.5 " 


11.5 " 


11 " 7.1 " 


11 " 5.0 " 


12.5 " 


12 " 6.2 " 


12 " 1.3 " 


13.5 " 


. 13 " 5.0 " 


13 " 2.5 " 



median mental ages parallel the median chronological ages. 
While the median mental ages run uniformly a month or so 
below the median chronological ages, they always fall well 
within the year covered by the ages of the corresponding 
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chronological groups. So far as this criterion is concerned, 
we regard our tests as satisfactorily ''standardized/' though 
actually we consider them as rather poorly standardized, he- 
cause we have evidence from the age and school-grade dis- 
tributions that the different age groups are not equally 
representative. 

As further evidence of the general accuracy of the present 
scale, we may cite the correspondence between measurements 
made by it with those made by individual testing. For the 
purpose of making this comparison, 51 children were tested 
individually by Kuhlmann's latest revision of the Binet tests. 
The degree of correspondence is shown, in terms of intelli- 
gence quotients, in Table VII. The uncorrected coefficient of 

TABLE VII 

Comparison op Intelligence Quotients Obtained by Group Testing 

WITH Those Obtained by Individual Testing with the 

KuHLMANN Revision. 



Chronologi- 


Intelligence Quotient 


Chronologi- 


Intelligence Quotient 


cal Age 






cal Age 






Group 


Individual 


Group 


Individual 


7— 5 


113 


111 


9-3 


114 


114 


7—2 


106 


123 


7—8 


121 


111 


7—10 


83 


85 


7—11 


108 


116 


7— 5 


93 


98 


7— 7 


115 


117 


7— 8 


105 


121 


9-0 


117 


124 


13— 7 


88 


99 


9— 7 


75 


75 


13-2 


67 


73 


8-7 


100 


102 


12— 5 


91 


82 


8- 6 


91 


102 


12—0 


97 


98 


8- 7 


107 


117 


10-11 


79 


80 


8- 1 


94 


107 


10-3 


79 


80. 


a- 9 


93 


91 


10-10 


79 


86 


8- 8 


100 


103 


10— 7 


77 


88 


8-3 


96 


100 


10-4 


91 


92 


8-0 


108 


111 


10-5 


91 


93 


8-4 


105 


101 


10—10 


103 


94 


8-10 


109 


105 


10—6 


93 


91 


8—6 


96 


104 


10- 7 


97 


114 


8— 1 


105 


119 


10- 8 


100 


100 


8-9 


90 


88 


10- 1 


93 


98 


8— 2 


96 


93 


10—0 


88 


82 


8— 7 


86 


102 


10-2 


83 


87 


7— 1 


101 


128 


10—11 


68 


77 


7—9 


95 


103 


9-5 


124 


124 


7— 


106 


111 


9-0 


96 


97 


7— 7 


120 


134 


9—11 


88 


92 
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correlation between the two sets of quotients is 0.78 (Bravais- 
Pearson). In view of the greater accuracy of individual tests 
as compared with group tests, the magnitude of this correla-' 
tion is rather surprising — particularly so when it is con- 
sidered that our tests are probably not the best that could be 
selected and that our norms are not to be regarded as finally 
perfected. We incline to contribute a considerable portion of 
the apparent success of the present tests to the method we 
have used, and to believe that inadequacy of the tests and 
norms is compensated by the advantages inherent in the 
methodological principles we have followed. 

A further interesting comparison between the results ob- 
tained in the present study and those of other investigators is 
afforded by Table VIII, which gives the distribution of cases 

TABLE VIII 
Distribution op the NIental Ages op Each Chronological Age Group 





7.-0 


8:0 9K) ^K) 


ifi, 


12K) 


13K) 




Mental Age 


to 


to 


to 


to 


to 


to 


to 


Total 




7:11 


8:11 


9:11 


10:11 


11:11 


12:11 


13:11 


Cases 


Less than 6:6 


6 




1 










7 


6:6— 6:11 


16 


1 












17 


7K>- 7:11 


30 


19 


6 


2 


1 






58 


8K>- 8:11 


17 


34 


21 


11 


1 


1 


2 


87 


9K>- 9:11 


3 


13 


18 


23 


11 


3 


3 


73 


10K>-10:11 




3 


7 


17 


18 


15 


3 


63 


ll.-0-ll:ll 




1 


4 


18 


14 


17 


5 


59 


12K>-12:11 






7 


3 


8 


8 


7 


33 


13K>-13: 5 






1 


1 


9 


5 


9 


25 


More than 13:5 






1 


' 4 


19 


25 


19 


68 


Total Cases 


72 


70 


66 


79 


81 


74 


48 


490 



by mental age. At the ages of 7.5 and 8.5, the mode and! 
median coincide, and the distribution appears fairly sym- 
metrical. At all of the upper ages, however, with the excep- 
tion of the small and unrepresentative 13.5 year group, the 
distribution of mental ages is skewed toward the lower end. 
Even the 7.5 and 8.5 year groups show a very slightly skewed 
distribution, when the exact mental ages by months are con- 
sidered. This is seen, for example, in the fact that the average 
mental age of the 8.5 year group is 8 yrs. 5.5 mos., while the 
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median mental age is slightly less, namely, 8 yrs. 4.6 mos. The 
number of cases is too meagre to justify final conclusions. At 
present, we may simply note the fact that our data suggest 
that the distributiion of mental ages varies with the chronolo- 
gical age of the group, being almost symmetrical at the ages 
of 7.5 and 8.5, but becoming rather definitely skewed at the 
higher ages. 

This tendency toward skewed distributions offers an expla- 
nation of several minor matters in some of the preceding 
tables. Sinc6 in a skewed distribution it is natural for the 
median to fall below the average, and since our norms are 
based on averages, it is possible to understand why, in Table 
VI, the median mental ages are slightly lower than the median 
chronological ages. Skewed distributions also account, in part, 
for the fact, brought out by Table VII, that the present tests 
very frequently give intelligence quotients which are lower than 
those obtained by the Binet tests, while at the same time they 
show, particularly at the upper ages, as seen in Table VIII, 
an unusually large number of children with a mental age well 
above their chronological. Pintner, using group tests, like- 
wise found a number of cases showing a mental age greatly 
above their mental age by the Binet tests, though the median 
mental age of the group with the group tests was a quarter 
of a year less than the median with the Binet tests.^® In a 
skewed distribution, it is easily possible for a heaping up of 
cases at the lower mental ages to be accompanied by a con- 
siderable number at the niore advanced mental ages. 

i« The Mental Survey, igiS* pp. 61-63. 
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"CROSS-OUT" TESTS 

WITH SUGGESTIONS AS TO A GROUP SCALE OF 
THE EMOTIONS 

STUDIES FROM THE PSYCHOLOGICAL LABORATORY OF 
INDIANA UNIVERSITY 



By S. L. Pbessby and L. W. Pressey 



The tests described in the present paper are all " c ross-out" 
tests — ^that is, each one asks of the subject that by crossing 
out some one thing he eliminate a wrong, irrelevant, or ex- 
treme element in a situation.^ The writers cannot avoid the 
feeling that the great stress at present being put upon rigid^ 
systematization in method and objectivity in scoring has re-' 
suited in" tiof "a few tests of form so artificial and unnatural 
as to serioiisly interfere with their usefulness.. The notion 
of the elimination of an extra or wrong element was hit upon 
by the writers as a way in which systematic method and 
scoring might be obtained, without any such sacrifice of ra- 
tionale or naturalness in the problem, as presented to the 
subject. To cross out a mistake is a very natural thing to do. 
It is a child's own method, as any teacher who has had to 
train children to erase instead of crossing out, can testify. 
From the subject's point of view the task presented in the 
tests is thus not at all unreasonablet* Such a framing of the 
problem is, in the second place, satisfactory from the point of 
view of the examiner, since the directions can be very brief 
and direct. Finally, so far as scoring is concerned, the plan 
is admirable ; either the wrong word or part is crossed out, or 
it is not. There is no writing, even of numbers. Indication 
of the answer by underlining is not wholly ideal (while being 
at the same time an unnatural and artificial way of answering 
a question) : not infrequently a line is put half way between 
two words — ^the writers have found subjects who put the line 

1 The general principle involved in the tests, and certain of the tests 
described in this paper, have already been mentioned briefly in a pre- 
vious article, Sex Differences Shown by 2544 School Children on a 
Group Scale of Intelligence, with Special Reference to Variability, 
Pressey, L W., Journal of Applied Psychology, Vol. II, 1918, pp. 323- 
340. 
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over the right word. But if the line is drawn through the 
word there is a minimum of possibility of misinterpretation. 

The writers have now tried this principle of the " extra " or 
" wrong " element in a variety of tests, with a variety of sub- 
jects, and have found it to work excellently. The present 
paper will describe briefly (1) a brief group scale of intelli- 
gence, to be used in school surveys, and applicable from the 
fourth through the eighth grade, and (2) a scale supple- 
mentary to this, for use from the kindergarten through the 
third grade; (3) a group scale for measuring emotional in- 
terests will be outlined, and suggestions made as to a test of 
learning, a test of ingenuity with geometrical forms, and a 
silent reading test. There is here surely variety enough ; but 
all these tests make use of this same "cross-out" principle. 
And one might almost say that a single brief direction would 
serve for all : " Cross out what is wrong, or does not belong 
with the others." 

I. Survey Scale Unit E 

The blank is partly reproduced below, only the first 5 of 
the 25 items in each test being given here. Briefly the direc- 
tions are as follows : in the first test the children are told that 
each list of words is a sentence with the words mixed up. 
But there is in each list one word that does not belong in the 
sentence. This word they are to cross out. In the second test 
the children are told simply tlo cross out in each list the thing 
that does not belong with the other four things. For the 
third test it is explained that the numbers in each list are 
arranged in accordance with some rule, but there is one num- 
ber in each list that breaks the rule; and this recalcitrant 
number they are to cross out. Finally, in the last test the 
children are told very simply to " Cross out in each list the 
thing that is worst." Five minutes are allowed for the first 
and third tests, four minutes for the second and fourth. 

The results below are from 850 school children (grades four 
to twelve inclusive) in an Indiana city of about 12,000 popu- 
lation. By total score on the four tests the results are as 
follows : 

Grades 4 5 6 7 8 9 10 11 12 

Number 178 147 in 89 68 102 56 42 57 

Medians 40.5 48.1 56.1 60.0 69.5 71. i 72.0 74.0 75.5 

25% ^,7 43.1 48.1 55. 1 64.0 66.4 67.5 64.2 72.6 

75% 47-2 54.2 60.2 68.2 75.0 74.6 77.2 81.0 80.0 

Results by the individual tests were for each grade as given 
in Table I. It will be seen that there is a fairly good progress 
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MENTAL SURVEY SCALES 
" Cross-out " Tests 



Schedule E. 



Name Sex . . 

Age Birthday Grade 

Teacher School 

Place State Date .. 



(2) 



TEST I. VERBAL INGENUITY 
Examples: ^a) see a I man on. 

(b) knife chair the sharp is. 

(c) cat dog the house after ran the. 
(i) the cat at see. 

(2) boy was sky the sick. 

(3) bread sweep will the kitchen I. 

(4) are going yesterday to-morrow we. 

(5) me mine give my straw hat, etc. 

TEST II. LOGICAL JUDGMENT 
Examples: (a) dog, cow, horse, oak, cat. 

(b) book, newspaper, magazine poster, pho- 

tograph. 

(c) chair, desk, table, wagon, book-case. 

coat, shoes, hat, gloves, cow. 
oats, wheat, barley, cotton, rye. 

(3) satin, silk, linoleum, calico, serge. 

(4) fly, ant, bee, grasshopper, mouse. 

(5) bread, meat vegetables, hay, fish, etc. 

TEST III. ARITHMETICAL INGENUITY 
Examples: (a) a 4 6 8 9 

(b) 7 6 5 6 

(c) I 4 7 9 

123945 
24678 
(3) 19 18 17 16 13 15 
5 7 10 15 20 25 
II 10 8 6 4 2 etc. 

TEST IV. MORAL JUDGMENT 
Examples: (a) Gambling, lying, drunkenness, murder, 
smoking. 

(b) begging, gambling, trading, cheating, 

borrowing. . 

(c) dullness, foolishness, laziness, weak- 

ness, poverty. 

(i) fighting, killing, hating, quarreling, hurting. 

(2) borrowing, gambling, overcharging, stealing, begging. 

(3) love, hate, fondness, dislike, liking. 

(4) dancing, drunkenness, flirting, over-eating, smoking. 

(5) holiness, reverence, piety, obedience, wickedness, etc. 



10 la 
a 7 
10 13 
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from grade to grade through the eighth (as far as the tests 
are expected to apply), with a level after that. 

As regards the structure of these tests the writers wish to 
call attention to the following points: (1) the possibility of 
chance successes is at a minimum; in the second and fourth 
tests the chance is one in five, in the first and third, still less ; 
(2) there is possible great condensation in the printing of the 
tests; an examination of one hundred clear-cut problems is 
presented on two sides of a single 12 in. by 9 in. sheeft of 
paper. Such condensation is saving of space, trouble in scor- 
ing and handling, and expense of paper and printing; (3) the 
method by which the subject indicates his answer is the ex- 
treme of simplicity ; he simply crosses out a word. The man- 
ual labor of taking the examination is thus at a minimum; 
and the rate at which the subject progresses is determined 
solely by his ability to solve the problems. Finally (4) scoring 
is extremely easy, rapid, and wholly objective. There is in 
each line only one correct answer. The subject has indicated 
his response to each problem not by writing, nor even by so 
simple a thing as a number, but by drawing a line through a 
certain word or number, one only in each line. It may be 
said that the examination takes less than 25 minutes to give, 
and the blanks can be scored at the rate of 70 an hour by 
student help. 

SURVEY SCALE UNIT E 

Results bt Tbst 

Test I. Test II. Test III. Test IV. 

Grade 25% M. 75% 25% M. 75% 25% M. 75% 25% M. 75% Grade 
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15 
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14 
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11.6 


13 
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13 


16.6 


18 


12 


14.0 


16 


11 


13.1 


16 


11 


13.0 


15 
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15 


17.7 


20 


14 


16.1 


18 


12 


14.9 


17 


13 


15.4 


17 
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17 


19.5 


21 


17 


18.7 


20 


14 


16.5 


18 


16 


17.3 


19 
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9 


18 


20.1 


22 


17 


18.5 


21 


14 


16.2 


18 


15 


17.3 


18 


9 


10 


18 


21.5 


23 


18 


19.6 


21 


15 


16.7 


18 


16 


18.2 


20 


10 


11 


16 


20.0 


23 


17 


19.6 


21 


14 


16.8 


18 


17 


19.4 


21 


11 



12 19 21.1 23 18 19.4 21 15 16.9 18 18 20.5 22 12 

But the writers wish to emphasize particularly certain fea- 
tures of the examination as it appears from the point of view 
of the subject. There is to each test a rationale and a plausi- 
bility that immediately arouse both interest in and understand- 
ing of the test, with only brief directions. The subject's re- 
sponse — the crossing out of an extra, incongruous, or unde- 
sirable element — is so natural as to be considered a matter of 
course. Further, the directions are in essence the same for 
all four tests, and the subject's response is the same. It may 
be said that for 850 subjects, from the fourth grade on, there 
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were obtained no zero scores on the total examination. There 
were only 8 zero scores on separate tests (5 of these on the 
third) and only 20 scores below 3 on any test (9 of these on 
the third). 

The writers have been quite as much interested in the indi- 
vidual tests as in any ratings that might be obtained from the 
otal examination. The first test might be expected to give a 
measure of language ability. As such it should have definite 
superiority over the Trabue Completion Scales in its absolute 
objectivity of scoring and its elimination of writing. It should 
in addition sample more complex mental processes, since the 
mental reconstruction of a sentence would seem a more elabo- 
rate effort than the mere completion of it. It should also be 
pointed out in passing that this form of " dissected sentences " 
is greatly superior to the form used in the army scale Alpha 
in its condensation of matter, its elimination of the possibility 
of chance success, and its elimination also of elements of in- 
formation from the problem. 
^ The second might be called a test of infonnation with un- 
derstanding.^ It should be noticed that the test presents in 
each line a problem in both differences and similarities. The 
subject must make sure that four things in each list are alike, 
and the fifth different from all the other four. The Binet 
separates the problems and asks either " how are these two 
things different " or " how are these two things alike." Group 
test phrasings of this problem have been of two forms ;. in 
one the subject is presented with pairs of similarities or oppo- 
sites, and is asked to underline either the " similar ** or " op- 
posite " as one or the other applies ; in the other he is given a 
word, followed by a number of other words from which the 
opposite or similar is to be selected .by underlining. The 
superiority of the present phrasing in compactness, natural- 
ness and simplicity of direction would seem unmistakable. 

The writers have hoped that the " arithmetical ingenuity " 
test might give a measure of potential arithmetical ability, and 
so give results in interesting contrast to results with tests of 
the fundamental processes in arithmetic, in classes where the 
teaching was poor but the abilities of the children good. The 

2 A test of this form for technical knowledge in a particular field 
would seem possible. A skilled mechanic might be given lists of 
various tools or processes, with in each list one process or tool not 
properly belonging there; four lathe parts and a milling machine part, 
for instance. 
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test in this present form, however, is not wholly satisfactory .• 
The product moments correlation for this test with results from 
a group scale of determined reliability previously described in 
this Journal* shows for 205 6th, 7th and 8th grade children 
a coefficient of only .34 as compared with .61 on the first test, 
.65 for the second, and .91 for the last. 

This high correlation of the last test with intelligence ratings 
otherwise obtained is extremely interesting. The test un- 
doubtedly involves vocabulary, and general capacity for ab- 
stract thinking, as well as moral sentiment and judgment. In 
formulating the test the writers had in mind, of course, these 
last abilities especially, and they hope to obtain results on this 
test from the state reform school, to see whether any rela- 
tion appears between ethical discrimination, as this test meas- 
ures it, and delinquency. But altogether aside from the in- 
terest of its special content, the test has, apparently, a sur- 
prisingly high value as a measure of " general ability." v 

Mental Survey Unit E is thus a scale of four tests, each 
test of independent interest, the combined result giving also 
something of a rating of " general ability." The writers have 
thought of the scale as of value chiefly for the purpose of 
comparing classes, schools, communities, or other groups.-^ As 
they have shown elsewhere," such comparisons may be of 
distinct value in the study of educational problems. They 
hope to present shortly data bearing on the sociological value 
of such group measurements. And they feel that ^or such 
investigation " research units " of the general nature and form 
of this small four-page examination, taking approximately 20 
minutes to give and scored with extreme readiness, are espe- 
cially satisfactory. 

II. Survey Scale Unit F 

Samples of the four tests of the examination are shown 
below : 

• The test is very poorly graded, and involves too great a variety of 
problems. It is now being revised so that the "numbers count up or 
down, multiply or divide in some regular way ; " such irregular pro- 
gressions as are shown in the thirteenth item are dropped altogether. 

* A Group Point Scale for Measuring General Intelligence. Journal 
of Applied Psychology, Vol. II, 1918, pp. 250-269. 

^ Presscy, S. L. A Comparison of Two School Systems by Means 
of a Group Scale of Intelligence, Educational Administrctiion and 
Supervision, Vol. V, 1919, pp. 53-62. 
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In the first test the children are asked to cross out the extra 
dot; in the second to cross out the thing that doesn't belong 
with the other two ; in the third to cross out the block left over, 
in each square, after the other blocks have been fitted into the 
four forms (square, triangle, cross and circle) at the top of 
the page ; in the fourth test to cross out, in each picture, the 
part that is wrong. Each test contains 25 items (with 5 items 
additional for examples). The children are allowed three 
minutes for each test. Results from 470 children in the 1st, 
2nd, and 3rd grades of the same system surveyed by means 
of scale E show the following results : 

Grades 

Number 

Medians 



I 


2 


3 


165 


158 


147 


34.7 


48.3 


57.0 



The medians for the separate tests at each grade were as 
below: 
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Grade 

I 

2 

3 


Number I 

165 5.5 
158 10.4 

147 13.3 


Tests 
II III 
10.9 6.4 
12.4 10.6 
13.6 14.0 


IV 

13.3 
17.0 
18.4 
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It will be seen that the tests are not as yet properly graded, 
but the general principle of each one of the four tests has 
proved satisfactory. All four tests can be "gotten over" 
even to kindergarten children, and indications to date would 
lead one to expect a high correlation with intelligence as soon 
as the problems are properly graded. 

The problem faced, in building these tests, was not an easy 
one. It was desired (1) that the tests should not require 
literacy, not even so much as knowledge of the alphabet or 
the cardinal numbers ; otherwise more or less incidental influ- 
ences such as early home teaching and training might play a 
disproportionate part in the results. The difficulty was to 
present zvithout the use of any such symbols, problems of 
such a complexity as would give a measure of general intel- 
lectual ability. It was also desirable (2) that the children 
should indicate their answers in some extremely simple and 
unmistakable way. Young children show too poor eye-hand 
coordination to ask them to complete a picture, follow through 
a maze, or go through similar complicated processes, in the 
group, without greatly lengthening the examination, wearying 
the children, and introducing difficulties of scoring which 
would make the examination almost impracticable. Finally 
(3) it became evident very early in the experimentation that 
very young children are as yet so little disciplined in habits 
of attention that directions of any length, or problems of any 
artificiality or lacking in intrinsic interest, were not to be 
thought of. The directions must be almost colloquial in their 
simplicity and directness; the test must, in fact, be self-ex- 
planatory. And the examination must have more the appear- 
ance of a game, than of a task to which there must be con- 
scious application. 

The " cross-out '* idea seemed admirably suited to the prob- 
lem. The dot pattern test was tried with some hesitation. 
The results show the items to be poorly graded, but the prob- 
lem of the test was better understood by the child than was 
expected (and this in a system without any kindergarten 
training which might afford some special preparation for such 
a test). So far as could be judged from the data now in hand, 
there is a fair correlation with general ability. 
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Test II involves the same problem as Test II of the previous 
scale (in picture form) and needs no further comment. Test 
III is an attempt to put a form board test on paper, and in 
such a way as could be used in the group. It is the result 
of a long series of experiments and has in it possibilities of 
further development which will be returned to shortly. The 
last test, which is obviously the best of the four technically, 
permits the presentation of an indefinite variety of problems, 
and of a range of hardness from 98% success in the kinder- 
garten to problems difficult enough to puzzle an intelligent 
adult." 

But the interest in the Primer scale has been not so much 
in the separate tests as in the total rating. The scale is an 
attempt to make possible a survey of the entire pupil material 
of a school or school system. As a matter of actual fact the 
data thus far presented is the result of such a survey of all 
the schbol children, from the first grade through High School, 
in a city of about 12,000 population.^ 

The writers have already^ presented data to show that 
schools may differ markedly as regards the grouping which 
they make of the children, as regards ability, in grades and 
sections. A survey which shall include the entire school sys- 
tem is thus necessary if an adequate picture is to be obtained 
of the school's disposal of its pupils. And a measure of the 
abilities of the children before such selective and formative 
influences have had much opportunity to operate is necessary, 
if a fair estimate of the community is to be obtained. This 
primer scale should then, if found satisfactory, give results 
of the greatest sociological as well as educational significance 
In fact, for all such group comparisons it should give data of 
unique interest." 

^ The test has interesting possibilities, as a trade test for example. 
A picture showing a piece of machinery with some part out of order — 
this part to be crossed out — would be excellent for such a purpose. 

^ It might be added that the total 1,321 children were tested in a day 
and a half, the primer scale being given exclusively by one of the 
writers and Scale E throughout by the other, and that the entire 1,321 
blanks were scored by student help at a total cost of $8.00. 

« See note 5 above. 

» It may be said, shortly, that children entering the schools located in 
the best neighborhood of the city surveyed averaged over a year in 
" mental age " above children (of the same chronological age) entering 
another school in a poorer section of the city, and that the median 
rating of grade i in the best school was approximately the same as the 
rating of grade 2 in the poorest. 



Digitized by 



Google 



CROSS-OUT TESTS 147 

III. Suggestions as to Other Tests, Especially of the 

Emotions 

The following tests have been only superficially experi- 
mented with, with small groups of school children or college 
students. There is thus no systematic data to present. But 
the tests are of some intrinsic interest. The writers are 
hardly likely to find time for further work with them for 
some time to come; and since they are based on the same 
"cross-out" principle, they are described briefly here. 

No one can have had any intimate experience with the 
feebleminded or the insane without feeling very strongly at 
times the almost pitiful inadequacy of a test of " general in- 
telligence " as a single means of measuring social and economic 
inadequacy. One very important element in such cases is lack 
of emotional control. The writers wish to suggest the fol- 
lowing four tests as making an interesting research unit for 
experimentation in the field. 

1. The first test (to be placed' on the first page of a four- 
page folder) consists of a story, beginning in very monoto- 
nous and colorless fashion, but in the middle of the page 
developing into a h)rper-adventurous train robbery episode of 
the dime novel type. Sown throughout the test are irrelevant 
words, 20 in the first section and 20 in the second. The direc- 
tions are to read the passage as quickly as possible, crossing 
out all the irrelevant words. The score consists of the dif- 
ference between the number of words correctly crossed out 
in the exciting, as compared with the uninteresting section. 

2. The second is a group adaptation of the familiar associa- 
tion test. There are 20 brief paragraphs of pied type on the 
blank. The subjects are told that 20 words will be read to 
them ; that as soon as the first word is named they are to cross 
out all the letters in the first paragraph which occur in this 
word, and so on through. The first ten words are not emo- 
tionally toned; the last ten, such as are likely to touch a 
" complex " or stir up some emotion. And the score is the 
difference between the letters correctly crossed out in the two 
groups. 

3. The third test consists of twenty-five lists of words, five 
words in each list. Some of these words are, for .the average 
person, highly emotionally toned, some slightly and some not 
at all affectively colored. The subjects are told to go through 
the lists and cross out all the words that are unpleasant. After 
this is done, they are told to go through the lists again and, 
in each list, draw a line aroimd the word that is most un- 
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pleasant. The slight experimentation' with this test would 
suggest that the number of crossed words gave something of a 
measure of a person's tendency to emotionalize — or of affec- 
tive spread. It is hoped that the number of deviations, in the 
selection of the most unpleasant word in each line, from the 
most common selection, may give a measure of neurotic 
" transvaluation." 

4. The last test consists of a list of about 150 words. Of 
these half occur in the previous three tests, half do not. Of the 
words occurring in the previous tests, half are words with 
strong emotional coloring and half are words with no coloring. 
And of the words in the list, not appearing in the previous 
tests, half are emotionally toned. The subjects are told to 
go through the list and cross out the words that they have seen 
before, in the other tests. The record is scored as to (a) 
the proportion of emotional to unemotional words remembered 
and (b) the proportion of emotional to unemotional words 
remembered wrongly. 

It has been the hope of the writers that they might find time 
to work out this four test unit with some care and obtain for 
purposes of comparison data from school children, a group 
of institutional feebleminded, and representative groups from 
the boys' and girls' state reform schools. No such results 
have been obtained as yet. But the writers are convinced, 
after a somewhat unusually varied and intensive experience 
in work with both the insane and psychopathic and the feeble- 
minded, that in such extreme cases, at least, emotional insta- 
bility is a gross enough thing to be measurable by some such 
means. And they feel very strongly that a study of the prob- 
lem by group comparison is particularly needed. Individual 
differences thus drop out and it is possible to get at type 
reactions.*® 

When there is any considerable foreign element in a com- 
munity tests intimately involving language can hardly be ade- 
quate. Other material is then necessary (such material may 
very well prove indispensable in all cases). That is, a group 
performance scale supplementary to scale unit E is needed. 
As two tests for such a scale the writers have experimented 
with (1) a puzzle test similar to the form board test above, 
showing at the top of the page a large square, and below in 
lines, groups of blocks, those in each group just sufficient to 

^^ In fact they have an idea that such tests might get at a person's 
emotional peculiarities better when that person felt himself sheltered 
by being submerged in a group than would be the case in an individual 
examination. 
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fill the square but with one block left over. The extra block 
is, of course, crossed out. The writers have already obtained 
results from about 200 children and find the test highly satis- 
factory. As a second test (2) the writers have already in 
trial form a variation of the digit-symbol test. It consists of 
the usual blank, but with the substitutions already made, and 
in each line one substitution made wrongly. The children are 
told that in each line there is one wrong substitution, and they 
are to cross it out. The saving of time and labor in taking 
the test, and of trouble in scoring, over the standard form is 
obvious. 

Finally the writers wish to suggest a new form of silent 
reading test employing the cross-out principle. Silent reading 
tests seem to fall into one of two pitfalls, either the pupils' 
performance cannot be objectively and satisfactorily scored or 
else his performance is more or less artificial, and with only 
a somewhat indirect bearing on the passage read. The writers 
have experimented tentatively with a silent reading test hav- 
ing such items as : " In winter the wind is very cold ; it blows 
against our house, and often finds its way in through the 
cracks and keeps the house warm." The directions are to 
cross out the one word in each sentence that spoils the mean- 
ing. The problem as thus phrased is easily presented to the 
pupils, the scoring is wholly objective, and labor in both giving 
and scoring of the test is slight. The problem presented 
seems, to the writers at least, much less artificial than is usu- 
ally employed in such tests and much more truly a test of 
comprehension of the meaning of the passage read. 

IV. Group Tests as a General Method of Research in 

Psychology 

A word remains to be said in defense of the presentation, 
in a single paper, of such heterogeneous material, much of it 
still in only experimental form. The writers have brought 
these various bits of experimentation together in just this way 
because they wish to emphasize the almost bewildering variety, 
in material, in method, and in problem, possible with the 
" group test." The tentative suggestions regarding four tests 
of the emotions will very likely be taken by the reader as 
amounting to little more than an opportunity for parlor amuse- 
ment. For the writers these few paragraphs are perhaps the 
most serious part of the paper. They represent an attempt to 
formulate — in group test form — certain materials for dealing 
with one of the most baffling problems of psychology. The 
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" tests " are not intended as a means of diagnosis, but rather 
as a method of investigation. The writers believe that the 
majority of psychological problems can be attacked with profit 
by the " group test " method. They feel that it would be very 
unfortunate if the methods brought to general notice by the 
army psychological work, of investigation in the gn^up, of 
S3rstematic condensation of matter and record, and studied 
economy of time and labor in giving and scoring, should be 
limited in their application to the study of "general intelli- 
gence." Particularly are. studies of groups as such likely to 
prove fruitful ; we should thus be able to determine types, and 
to relate psychological study to large educational, sociological, 
and economic facts. The " group test " has appeared in the 
army work as a new method for dealing with certain problems 
of general intelligence ; in reality it is a new method of investi- 
gation, applicable to the entire field of psychology. 

Summary 

The paper may be briefly summarized as follows: 

1. The present emphasis upon rigid standardization in 
method and objectivity in scoring is tending toward tests 
of form so artificial and unnatural as seriously to interfere 
with their usefulness. As one way of obtaining greater nat- 
uralness — without sacrificing method — ^the writers suggest the 
formulation of test problems in such a way as to involve the 
elimination, by crossing out, of a wrong or unnecessary ele- 
ment. 

2. First forms are presented of two brief group scales mak- 
ing use of this device; one for grades one to four inclusive, 
the other for grades four to eight, — the two together per- 
mitting the survey, for purposes of group comparison, of en- 
tire schools and school systems, from the kindergarten up. 

3. Certain tests of special abilities, and a brief scale designee! 
to measure emotional control, are suggested. 

4. A plea is made for the recognition of the " group test " 
as a general method of investigation in psychology. 
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A COMPARATIVE STUDY OF THE VARIABILITY OF 
BOYS AND GIRLS 



By Gbokge W. Frasier, Washington State Normal School, Cheney. 



During the past decade much has been written and said 
about the variability of the sexes. One school of psychology 
maintains that there are no median sex differences of mental 
capacities, but the ability of the male is scattered over a 
greater range, that is, he is more variable. They thus account 
for the fact that more men than women have become famous, 
also that more men are in the low levels of society. The other 
school of psychology believes that there are no sex differences 
either in variability or central tendency. Furthermore they 
maintain that it is the present constitution of society that puts 
men into the extremes. The question of variability as applied 
to children is of vast practical importance to those who deal 
with boys and girls. Shall we deal with children on the as- 
sumption that boys should be fotmd in the extremes and the 
girls in the middle ground ? 

The literature of the subject can be separated into two 
classes (1) studies dealing with men and women and making 
no mentioii^^ fe^ys and girls and (2) those dealing with chil- 
dren. It'is evident that many students of this subject draw 
their data from the behavior of adults, make their conclusions 
on such data and then apply their findings in dealing with 
children. This attitude is not justified by facts. The follow- 
ing study deals with school children, and for this reason the 
quotations taken from other authors will be confined to those 
dealing with boys and girls. 

Keyes made a special study of all the children in one school 
district, having six or more annual records available. He 
found 1,902 children distributed as is shown in Table I. 

TABLE 1 



Repeaters 

Gainers 

Normal 


Boys 

373 

314 

302 


Girls 

310 

299 

304 


Total 


989 


913 
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He concludes from the above table ^ " The boys in this 
group (repeaters) are more numerous than the girls, as would 
be expected from the known greater variability of the male," 
also "The gainers or accelerates were 613 in number; 314 of 
them boys, 299 girls. The greater variability of boys is here 
again shown." 

A casual glance at the table seems to vindicate the conclusion 
made by Keyes. However, it is to be noted that the totals show 
76 fewer girls than boys. Now, Keyes has assumed that had 
these 76 girls been present all of them would have been in 
the " Normal " group. To overcome this inequality and show 
the true comparison between the boys and girls it is necessary 
to reduce each group to the percentage of the total. The per- 
centage grouping is shown in table 2. 

TABLE 2 

Boys Girls 

Repeaters 37.7% 33.9% 

Gamers 31.6% 32.7% 

Noraial 30.5% 33.3% 

The above table indicates that when these data are reduced 
to a comparable basis the greater variability of the boys 
vanishes. 

Thomdike believes that boys are more variable than girls, 
for he writes * "Athough the male and female types are closely 
alike in intellectual capacities, there is an important difference 
in the deviations from the type in the two cases, namely, that* 
the males deviate more. The highest males in any quality are 
more gifted than any of the women, and the lowest males in- 
ferior to all women. Thus, though girls in general rank as 
high or higher than boys in high school and college, they less 
often lead the class ; thus there are far more eminent intellects 
among men than among women and twice as many idiots." 
In a foot-note he offers the following explanation : "This dif- 
ference is not absolutely proven to exist but it appears fairly 
certain from the results of several investigations." 

Rogers and Mclntire in measuring the intelligence of chil- 
dren with the Binet-Simon scale found that * " The principal 
outcome is the familiar law that there is a wider scattering of 
ability among boys than among girls; consequently there are 
more gifted as well as more backward boys than girls," and 

1 C. H. Keyes. Progress through the Grades of City Schools, p. 15, 
17 and 32. 

* E. L. Thomdike. Principles of Teaching, p. 96. 

* British Journal of Psychology, 1914, vol. 7, p. 265. 
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"so far as we go, our experiments support the general law, 
which several observers have already noted, that there is a 
greater variability of capacities in boys than in girls, but no 
general superiority." 

The most complete study made in America dealing with the 
case in point was made by Terman. Terman studied 1,000 
unselected school children from the standpoint of intelligence 
and came to the conclusion that * " The supposed wider varia- 
tion of boys is not found. Girls do not group themselves 
about the median more closely than do boys. The range of 
I Q including the middle fifty per cent is approximately the 
same for the two sexes." 

Leta Hollingworth made a very complete resume of studies 
concerned with the variability of the sexes and pointed out 
that up to 1914 these had not established the greater variability 
claimed for the males. She says " — and there is at the present 
time no conclusive empirical evidence to show that in cases 
where the coefficient of variation is greater for one sex than 
for the other, this greater variability consists of greater 
range." ' 

It appears from the quotations given that the subject is 
far from settled, and for this reason the following data are 
presented. 

It is claimed by the school of variability that whenever 
males and females, or boys and girls, undertake a task that 
the best progress and the slowest progress will be made by the 
boys, and the girls will compose the great bulk of median 
ability. Then, one would expect this law to hold true in school 
accomplishment. 

It appears that should we select all of the boys and girls of 
a certain age in any school system or systems we could, by 
finding their grade location, determine the relative variability 
of boys and girls of that age. 

Thirteen was selected as a desirable age because (1) chil- 
dren of this age are held in school by the attendance laws in 
most states and (2) at 13 a child has been in school long 
enough to demonstrate his ability. 

The grade location of all thirteen-year-old boys and girls ^ 
was found for twenty cities:" Boston, Mass.; Columbus, ■ 
Ohio; Wichita, Kansas; Grand Rapids, Mich.; Kansas City, 
Mo. ; Richmond, Va. ; Winston-Salem, N. C. ; Baltimore, Md. ; 

* L. M. Terman. The Measurement of Intelligence, p. 70. 
'^American Journal of Sociology, 1914., vol. 19, p. 510-530. 

• The data concerning these children were taken from the city school 
reports. 
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Cleveland, Ohio ; Trenton, N. J. ; Philadelphia, Pa. ; Danbury, 

Conn. ; Fall River, Mass. ; Winchester, Mass. ; Beverly, Mass. ; 

York, Pa.; Williamsport, Pa.; Aurora, III.; St. Louis, Mo.; 

Waterloo, Iowa. Table 3 gives the total number of each sex 

in each grade. 

TABLE 3 
Grade Boys Girls 

1 56 41 

II 227 172 

III 792 676 

IV 2,458 2,008 

V 4.844 4,334 

VI 6,904 6.561 

VII 7.744 8.333 

VIII 5,798 6.708 

IX 1.729 2.355 

X 212 249 

XI 10 8 

Total 30.774 31.445 

Median 7.01 7.24 

Q» 5.81 6.10 

Q» 8.01 8.22 

Q 2.2 2.12 

C. V 16 14. 



The coefficient of variability for the boys is slightly greater | y 
than that for the girls but the difference is so very small that ' 
no greater variability can be said to exist. In order to show ' 
all possible comparisons between the boys and girls chart A 
is given showing nine different percentiles, for each sex and 
their relative locations. 

It is evident from the chart presented that girls make 
better school progress than boys. From the standpoint of 
variability our data point clearly to the conclusion that no sex 
differences are shown. The statistical procedure is carried 
out from the second to the ninety-eighth percentile so that 
the question of greater range is disposed of. 

It is safe to conclude from the study of 62,219 thirteen- 
year-old boys and girls in 20 cities that the greater variability 
claimed for the teys is not present. It appears that this 
greater variability has never been established with any large 
number of cases or with any degree of certainty and if it is to 
be used as a working basis for those dealing with boys and 
girls it will be necessary for its supporters to present some 
conclusive empirical evidence. Until this is done it seems 
safest to disregard such a theory and deal with boys and girls 
on the supposition that they are alike so far as mental varia- 
bility is concerned. 
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MENTAL ATTITUDES IN DEBATE 



By Walter B. Swift, Boston 



In speaking of mental attitudes in debate I am going to limit 
the subject to the moments of actual debate, to the few minutes 
when the speaker is on his feet before the audience. I shall 
have nothing to say about the time before or after the speech. 
What I have to say concerning development and change of 
mental attitudes will come later. 

By " mental attitude " I mean " state of mind." Another 
name for mental attitude is " feeling," and another is " dis- 
position." However, this feeling or disposition is not the nor- 
mal feeling or disposition of the debater, the feeling that he 
holds generally, but is one which he holds during the moments 
when he is presenting his debate. It dominates him and domi- 
nates the situation at the time, but, unlike usual states of mind, 
it is not caused by the situation. On the contrary, it causes 
the situation, of itself. Again, the words which the debater 
is using do not cause the situation, but it dominates those 
words and gives them their effect. For example, suppose some 
one arises and says a few words. What he says may be clear, 
grammatical, and thoughtful. Yet the words themselves will 
not tell the whole story. There will be behind them Si feeling, 
a state of mind — what I prefer to call a mental attitude — 
that will show through the w^rds and impress itself upon the 
listeners. The words will mean more than they actually ex- 
press, and they will do so because of the feeling that creeps 
into them and through the voice of the speaker. 

Now as a rule, in the club of young debaters, most attention 
is given to the English and to an oratiorical utterance. I have 
no fault to find with either sort of thing — indeed, I realize 
their value and I favor and encourage them. But I wish to 
emphasize the fact that this side of debating, which is a wholly 
external one, is not the only side to consider, and that possibly 
the other, the internal, mental one is after all the more im- 
portant of the two. 

Keeping this difference in mind, then, let me illustrate a 
little. 

The usual way of reciting Yankee Doodle is somewhat likc^ 
this: (Simple) 

156 



Digitized by 



Google 



MENTAL ATTITUDES IN DEBATE 157 

Yankee Doodle came to town 

Riding on a pony. 

He stuck a feather in his hat 

And called him macaroni. 
I can now so change my state of mind that an entirely 
different presentation is called for: (Sad) 

Yankee Doodle came to town 

Riding on a pony. 

He stuck a feather in his hat 

And called him macaroni. 
Here let me call attention to one important thing : that each 
time I recited the stanza the words were exactly the same! 
Whatever change, therefore, was noticed in the reading was 
due to something else, to the change in my mental attitude as 
I recited the lines. 

Here one may object that these two ways of reading are 
the only ones possible to this particular bit of verse. Let me 
answer by a third reading: (Revengeful) 

Yankee Doodle came to town 

Riding on a pony. 

He stuck a feather in his hat 

And called him macaroni. 
These three ways of reciting the same words are sufficient 
to show that the change in the mental background may be a 
very varied thing, and that as the mental attitude changes, the 
rendering of the spoken word changes too. 

Now what happened in my mind to cause this difference in 
my three readings? It was not a mere trick of the voice, but 
a real change that occurred much farther back than in the 
vocal mechanism, a change in the working of the mind that 
governs the vocal cords. 

When I read Yankee Doodle the first time I did so in the 
usual way, giving the words the natural interpretation. But 
the second time I caused myself to think that Yankee Doodle's 
mother had just died ; that he had come to town to attend her 
funeral; that he and his mother had been intensely dear to 
each other ; and that her death was in consequence a great loss 
to him. This gave the recital an atmosphere of intense 
sadness. 

At the third reading I pictured to myself the disastrous 
dealings of an enemy and the return of Yankee Doodle to the 
town for revenge. He had come to punish underhanded 
doings. Thus the reading reflected the change in mental 
attitude. 
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Just what I mean by mental attitude should now be clear. 
It is not personality, it is not quality of character, it is not 
a mental trait; it is rather an interpretation of the situation, it 
is the color or imaginative turn that one gives to his mind 
under the stimulus of a situation; it is the way that one de- 
liberately makes himself feel in order that he may give force 
and an arousing power to his words. 

Some may think that this is a little thing, that it is limited 
to little feelings or little mental attitudes which anybody can 
assume at will. I am going, therefore, to give two or three 
brief examples, in order to show the great variety and the 
possible power of these mental attitudes. 

The first example will be the famous soliloquy in Hamlet, 
beginning with the phrase " To be, or not to be." Hamlet is 
at this point in despair and has come almost to suicide. At 
the verge he pauses a moment to think. So he is considering 
killing himself when he says "To be, or not to be." This 
phrase, when spoken in the first context, will sound quite dif- 
ferent to any one whose senses are acute from that spoken in 
the second context. One easily realizes that each connotes 
quite a diflFerent thing. The feelings of the listener were 
different in consequence, and so were those of the speaker. 

Let us take another example from Shakespere. Shylock 
says " I stand here on my bond." The situation was that he 
had just lost his ducats, that his daughter had eloped with a 
Christian, and that his ships had gone to the bottom. It must 
also be remembered that a Jew always desires full return on 
an investment and that he never makes one except upon that 
expectation. With these things in mind one will understand 
Shylock's feeling at the moment and see why he was so bitterly 
eager for revenge upon Antonio. So he turns to the judge 
and says, " I stand here on my bond." Here one can hardly 
fail to perceive or imagine the difference between the first and 
second utterance of the same phrase, and also between this 
phrase and the line from Hamlet's soliloquy. Now so great 
a change could not be caused except by a great increase in 
mental intensity, by a marked alteration in mental attitude. 
Obviously the change is not in the words, nor is the essence 
of it in the altered vocal mechanism (for there is undoubtedly 
a change there), but it is in the mental concept or picture, in 
the state of mind, in the feeling which animates the words of 
the speaker and gives them force and power. Furthermore, 
the listeners are aware of the change, and that fact is utilized 
by the speaker. 

Let us now consider a case where the situation is reversed. 
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As I sat at the table the other day I asked my wife, who is also 
a physician, a very complicated physiological question. She 
hesitated before answering, then proffered this shrewd reply, 
"That all depends upon the context." She had hardly time 
to take another breath when my little three-year-old piped up 
and said "context." She had caught the closing word and 
repeated it as she heard it. It is surely fair to suppose that 
the child in using the word for the first time could scarcely 
have the slightest idea of the concept that goes with it, of 
what is meant by the word. How completely then it lost its 
power and how surprisingly it fell short of any intellectual 
mark. 

This last illustration seems to me the best I could give to 
make my point absolutely clear. The reason is that we have 
a word uttered by a mind which is able to clothe the word 
with meaning and to arouse therefore an idea in another mind. 
The word is then repeated by a third person in such a way 
that all meaning leaves it and it becomes a mere sound echoed 
for the pleasure that the mere sound gives. It shows how 
blank and empty of concept a word can be, how devoid of 
weight, thought, or implication. These three examples should 
make clear how the same words can be so uttered as to give 
totally different impressions, and how these impressions de- 
pend upon the attitudes which mold the mind of the debater. 
Let us turn therefore to a consideration of the principles that 
govern these mental attitudes. 

THE PRINCIPLE OF MENTAL ATTITUDES 

Mental attitudes, or states of mind, take numerous forms, 
and may be divided accordingly. The usual division is that 
of thought, feeling, and will, or, more strictly in accord with 
psychological usage, intellect, affection, and will. In consider- 
ing mental attitudes under these three headings, however, I 
do not mean to imply that here we have a cut-and-dried, 
sharply defined boundary between any two. As in psychology, 
the division is rather a matter of convenience than of abso- 
lute separation, and though they are considered apart, two or 
even three may occur in any single speech, with one dominat- 
ing the others. Which dominates at a given time depends 
wholly upon the subject, the effect one has in mind, and the 
countermoves of his opponent. For convenience we will con- 
sider them separately, and at first, at least, in a general way. 

1. Intellect. Intellectual attitudes take account of many men- 
tal processes. They have chiefly to do, however, with state- 
ments of fact, with thinking in the ordinary sense, with con- 
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sideration and reflection, and with innumerable combinations 
of these same things. 

In the mention of bare facts there is merely the mental atti- 
tude of unvarnished repetition. This is the simplest and 
easiest understood of all the mental attitudes. A statement of 
fact has little behind it except the speaker's determination to 
make a certain fact absolutely clear to his hearer. The weight 
and the impression which it gives is simply the weight of its 
own truth, and the truth has only the effect of inescapable 
fact itself. To have any effect, facts must be clearly stated 
and perfectly understood, but beyond clearness they need ask 
no more. If, for instance, I say " The railroad curves around 
at this point in a very sharp, abrupt turn and then continues at 
right angles," the statement is one of pure thought. It is the 
maintaining of a truth, the facts of which are undisputed, 
and which has the weight of truth and no more. 

Such a statement of fact is manifestly very simple. Thought 
in general is far more complex. Instead of being confined to 
a single statement it continues to dominate over a series of 
them, and it goes from a bare statement of fact such as I have 
already given to the speaker's interpretation of those facts. 
This interpretation is really the statement of some conclusion 
to which the speaker has been led by a consideration of the 
facts themselves. It is affected therefore by the speaker's 
attitude toward the facts, and it receives credence in an audi- 
ence in accordance with the degree of influence which the 
speaker possesses in that audience. If I am President Eliot, 
my thought probably carries weight; if I am the Kaiser my 
authority carries much weight, but my thought carries little. 
As I am, my thought on some subjects has weight, in others 
none. Thus in an audience the weight of one's opinion is a 
variable quantity that cannot always be depended upon to 
make a point. For example, if I say to an audience " It is 
my idea that the Allies will win," and if the hearers know that 
I have had no military training, my opinion falls to the ground. 
Suppose, on the other hand, I say to an audience, " I think his 
speech defect can be cured in three months." If I have had a 
better training and a wider experience in speech defects than 
any other man in this country, my opinion would be received 
with respect. This is enough to show that a mental attitude 
may depend for its effectiveness on circumstances outside the 
speaker's control and that to give expression to it may be 
dangerous. 

One other kind of thought may very well be employed in 
debate. That is logical thought, hogicai thinking is not mere 
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opinion, mere assertion of one's own ideas, but a careful ad- 
vance by reasoning from one conclusion to another. The 
audience is led along the same path of thought and brought 
irresistibly to the same point that the speaker has reached. 
This is one of our regular debating devices, of course, and 
needs no further development here. 

Consideration is very like thought in nearly all respects. Yet 
it differs enough for me to call attention to it. As a mental 
attitude consideration is the same as " mulling a thing over in 
one's mind." The Bible says, " Consider the lilies of the field, 
they toil not, neither do they spin, and yet Solomon in all his 
glory was not arrayed like one of these." Now a remark of 
that sort is thrown out to be mulled over, as food for thought, 
so to say. Ultimately, it will be worked up into a conclusion 
which will move the audience from a previously held opinion. 
But that final use does not yet come into one's consideration. 
We are now merely considering; as it were digesting the men- 
tal food. As a mental attitude consideration is of tremendous 
value to the speaker. It elicits the attention of his audience, 
turns its attention to new things, and imperceptibly moves 
them from a previous position by the simple request to look at 
a new one. Combined with the point to which it leads and 
the final step which it induces, consideration is much like the 
ordinary advertisement. It has been found by psychologists 
that the ideal advertisement, the one that attracts a reader, 
holds his attention, and finally leads him to buy, always begins 
by telling him to consider something of common interest. 

So far as the intellectual process is concerned, reflection is 
much like consideration. More exactly, it is consideration for 
a second time, a looking back, a re-view, a re-consideration. 
When you assume a reflective attitude of mind and ask your 
audience to reconsider data already examined, you appeal to 
their sense of fairness, and you get a cordial hearing because 
you appeal to this sense. So if you say to them, ** Gentlemen, 
I beg you to reconsider these facts, in a little different light," 
you secure a new hearing and a new chance for victory. 

2. Affection. Under the heading of affection we may 
consider such things as pleasant and upleasant feelings, the 
being drawn to a matter under consideration or the being re- 
pulsed from it. We have there favorable and unfavorable 
affections. Shylock's desire for revenge, one's love of his 
country, and the whole range of personal likes and dislikes 
illustrate the feelings that we have for people and things. May 
we ask at this point, what of it ? Why consider feeling at all ? 
Why do we have the mental attitudes of like and dislike to- 
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wards any subject-matter? Why not be intellectual and 
matter-of-fact individuals, devoting our lives merely to enu- 
meration? The debater's reason is this: He wants to make 
our audience like and dislike. The thing that he wants the 
audience to like is his side of the question; in fact, he wants 
so completely to charm them with his interpretation and his 
presentation that they will like it to the complete exclusion of 
the other side. 

On the other hand, we want that same audience to dislike 
the opposite side of the question, and we want them to dis- 
like it to such an extent that nobody can ever say anything 
that will make them like it again. If I am on the affirmative, 
I am going to try to make my audience like the affirmative and 
dislike the negative; if I am on the negative, I am going to 
make my audience charmed with the negative and disgusted 
with the affirmative. This I hope to do through maintaining 
an undercurrent of feeling towards my subject, assured that 
my audience follows through imitation the feelings of the 
speaker. It may be important at this juncture to explain 
briefly the reason for this. It is a large subject, and deserves 
fuller treatment, but I think that a short illustration or two, 
or, better, reference to the illustrations that have been given 
before will lead the reader to agree with me that the audience 
tends to follow the feeling of the speaker. 

The first time that I recited Yankee Doodle, the hearer 
probably had absolutely no feeling in the matter whatever, 
but the second time, after I had filled my mind with the con- 
ception of the funeral and the sadness caused by the death of 
the boy's mother, he surely did catch the feeling; and notice, 
he caught that feeling before I had given him any interpreta- 
tion of the reason why that feeling should be there. That is, 
he felt the sadness of it without Imowing why I had a reason 
to be sad. This illustration will I believe prove that the audi- 
ence tends to perceive and reproduce the feeling of the 
speaker. 

Let me pursue the subject a little further. Take for 
example the experiences through which Shylock passed be- 
fore the trial. They give cause for the growth of the Jew's 
intense desire for revenge upon Antonio. Now it is at this 
point profitable to ask, what is the effect of that intense desire 
for revenge upon the audience before which he is speaking? 
It may be one of two. The audience may keep pace with 
Shylock and completely sympathize with him, as they probably 
will if he has carried them along naturally to his final climax ; 
or it may do entirely the opposite ; it may take sides with the 
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opposition to Shylock, and agree entirely with those who plead 
for mercy. However, as I have watched audiences at this 
play, feeling has always wavered ; that is, the audience some- 
times has followed Shylock and sometimes followed the oppo- 
sition, usually adhering to Shylock if he is not too severe, and 
then going over to the opposition if it is not too weak in its 
appeal for mercy. All this makes " The Merchant of Venice " 
an extraordinary example of the very thing I am trying to 
illustrate, for it shows how an audience tends to follow the 
feelings of the speaker, inclining toward revenge or mercy 
as either is forced upon them by the actor. 

Let this suffice for our consideration of the mental attitude 
of feeling. It is a difficult thing to attempt before an audi- 
ence, for so to affect people that they will feel kindly toward 
one's own side of the debate and unfriendly toward the oppo- 
site is a subtle and delicate mental performance. Yet difficult 
as it is, it is worth while. Usually it means victory if one can 
so accomplish it at the outset that throughout the rest of the 
whole debate one's hearers will maintain a liking for one's 
own side and a dislike for the other. I know that oratory is 
commonly scorned by the academic trainers of speech, but 
this is not because real oratory deserves scorn. It is because 
the academician fails to understand the depth to which the 
non-academic oratorical principles penetrate. I am fitted to 
talk upon this subject, because I have been trained by both 
schools, by the academic and the non-academic alike. I am 
not at all, to be sure, a typical product of either, for I am 
absolutely out of practice. I can, however, as a teacher bring 
to others results to which I cannot myself attain. My study 
in both of these fields leads me to the following understanding 
of the situation. 

The academic school has emphasized throughout in its 
method of education and training what I call the external 
method; that is, the word form, the external enunciation, the 
intellectual cast of the language itself, with program of argu- 
ment and tabulation of statements and points. On these 
things they lay the chief emphasis. The non-academic school, 
on the other hand, proceeds from within outward. They 
make their chief aim the development of thought processes, 
the development of power to visualize and picture ideas and 
conceptions and to throw them clearly upon the screen of the 
mind. To do this they must of course have a means of expres- 
sion; they must have speech to tell it all, and words to de- 
scribe. This they do have, but by no means do they put their 
chief emphasis on words. Be it far from me to condemn 
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either of these schools. They both have their value and 
charm; and they both have these to such an extent that the 
whole matter of speech in debate is seriously wanting where 
it falls short of possessing all the excellences of both. 

I am also aware of the fact that each of these schools 
criticises the other unfavorably. The academic school, or the 
school of the external word, criticises the other because it 
lacks good English, lacks expressiveness in words, lacks power 
to put in the word itself all shades of meaning ; because it de- 
monstrates too much feeling in its utterances, ("gush," as 
they call it) and so on. The non-academic school, or the 
school of the internal thought, criticises the academic because 
it puts too much reliance upon the ability of words to carry 
ideas ; because it uses no other methods of external expression 
than language; because it fails to utter the same series of 
words now in a simple fashion, now with the atmosphere of 
melancholy interpretation, and now with the blue sky of a 
sunny disposition, changing the view completely. The non- 
academic school also finds fault because the other fails to give 
in its renderings much else besides the word; because it fails 
to give shades of thought ; because it fails to give minute color- 
ing of interpretation ; because it fails to give an overshadowing 
feeling, a tremendous madness, or the utterance of an in- 
satiable revenge, no matter what the words may be. My study 
in both of these schools has taught me that the non-academic 
school has by far the best of the argument. I grant that the 
non-academic school lacks in vocabulary, fails in the presenta- 
tion of completely polished English, and may sometimes be 
guilty of the seemingly unpardonable rhetorical sin of using 
words not strictly according to the dictionary rules; but I 
maintain that the excellences of the non-academic school can 
outnumber and outweigh all these little, minor, and pardonable 
faults. 

Some of the things that the non-academic school can do 
which the academic school cannot do are these: The non- 
academic school can maintain an extreme variety of mental 
attitudes over and above any words that one can give them to 
say. Those mental attitudes they can vary according to the 
state of mind into which they choose to put their audience, 
with all the shades of feeling, intellect, and will. They have a 
tremendous power and sweep of the imagination, and they 
have their creative imagination so developed that they can 
picture vast conceptions on the spot. And they can do not only 
these things ; beside all this and to a degree that I have never 
seen in any academic debater, they can read their audience 
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and judge from its action what sort of an effect they are 
making, and from this reading shift their arguments, and move 
their debating procedures accordingly. Not only can they read 
their audiences, but they can comprehend the mental attitudes 
in the speakers of the opposition to a remarkable degree. In 
fact, they can look through and above the words the man 
utters and understand his intellectual coloring, understand 
his imaginative interpretations, understand his shade of feel- 
ing in the way that no purely academically trained debater can 
possibly do. 

In brief, the academic people fail to appreciate the introduc- 
tion of feeling into debates. They believe that usually debate 
should be without feeling, and, as far as possible, entirely 
unemotional. The other school insists that emotion has its 
place, its service, and is one of the most valuable elements that 
can be introduced in debate if properly and opportunely em- 
ployed. From all this I may draw the conclusion that the 
mental attitude of emotion has an unusual and subtle power 
in debate and deserves serious consideration and cultivation. 

3. Will. Will is psychologically choice, and the employment 
of will as a mental attitude means an appeal to the will or an 
appeal to the choice of a hearer. You know that you can per- 
suade him ; you know that sometimes you can drive him ; you 
know that sometimes through feeling you can so elicit his 
sympathy that he will be led entirely by it. But just here we 
have a definite requirement. You must lead him to his own 
choice. That is, you must lead him to what he thinks is his 
own choice, but really what you, by your skilful presentation, 
have led him to choose. He must not know of your leader- 
ship; he must only know that you present facts, interpreta- 
tions, likes and dislikes in such a way that he seems himself to 
choose ; and of course you wish your hearer to choose the side 
that is favorable to yourself. 

To lead another to choose is a very complex and difficult 
matter, but it is an object that one must try to attain all the 
time one is arguing. If the end and aim of one's speech is to 
appeal to the hearer to make his choice one must make clear 
statements of fact, must persuade as far as one can to a point 
of decision, must reform the hearer's consideration of one's 
subject, must guide and prejudice his reflection in such a way 
that he cannot be drawn to later interpretations of an opposite 
nature, one must appeal to his feeling of patriotism, to his 
love of home, to his honor, his sense of justice, and his hatred 
of every thing that is wrong, in order to force his decision and 
force it to one's side. Then, lastly, the speaker by his mental 
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attitude of will must force his hearer to make a final change 
from his own preliminary choice in the matter, to the 
interpretation presented by the speaker. 

To sum up, the mere words of the speaker are the smallest 
part of the ideas, concepts, and feelings, which his mind seeks 
to present. Behind the words he possesses knowledge, makes 
reflections, maintains mental states, develops mental attitudes, 
and expresses all of these more or less independently of the 
words, and reproduces them, as far as the hearer is sensitive 
enough to perceive, in their original form within the minds of 
the audience. 
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A CASE OF INTELLECTUAL DEVELOPMENT DE- 
SPITE ENFORCED SECLUSION 



By Josephine Curtis Foster, Chief Psychologist, Psychopathic Hos- 
pital, Boston 



The psychologist who gives mental tests is frequently met 
by the statement " This low mental age means ntothing because 
the child has been sick and has not been a regular attendant at 
school " or by " You can't expect a child who has lived on a 
lonely farm and who has had no playmates to test at age." In 
vain may the psychologist answer " I admit that inability to 
read may lower the mental age with a scale like the Binet or 
the Point Scale. In other respects, however, school training 
has little influence on the outcome of psychological examina- 
tions." Such a reply usually fails to carry conviction to one 
who is not an experienced examiner. Instead, an objector 
is likely to depart, thinking that the psychologist is grossly ex- 
aggerating the importance of the tests, resolving to take mental 
ages in the future with as large a grain of salt as ever, and 
continuing to consider the mental age only when it agrees 
with his personal opinion of the case. 

In our work at this hospital we have come to use the answer 
" Let me tell you about a fifteen year old boy we examined 
some months ago." The illustration has been so successful 
that we offer it here to other psychologists for similar use. 

The Story of John 

John Henry ^ was bom in a rather poor district of a New 
England city on August 13, 1902. Of his remote ancestors we 
know comparatively little. Presumably his paternal grand- 
parents were natives of Ireland. His maternal g^ndparents 
are said by one of our informants to have come from England 
and Scotland, and by another to have been bom in Nova Scotia 
and Maine. We have one history which says that a maternal 
tmcle died in an insane asylum. Another maternal uncle, who 
came to the hospital upon request, is reported to have been 
insane, appeared to be very unintelligent and was considered 

^ This, of course, is not the real name, but it is like it in having the 
same second name (which the boy spelled Henery). 
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as "probably untrustworthy in his statements." This uncle 
denied mental illnesses in the family, but at the same time 
showed such familiarity with hospitals for the insane as to 
suggest personal acquaintance. Of the immediate family, the 
boy's father was bom in Ireland, and was probably a horse- 
trainer. He was heavily alcoholic, abused the children, and 
some five years ago deserted the family. John's mother was 
bom in New England. She was at this hospital for a time, 
and is now an inmate of a state hospital for the insane with 
a diagnosis of Dementia Praecox, paranoid. Four of John's 
siblings are said to have died of starvation in the first year. 
An older half-sister is apparently normal. 

The schooling of John and this half-sister, whom we ^hall 
call Julia, was decidedly meagre. They were allowed to attend 
occasionally, but although both of them learned to read, they 
acquired little else. If we could add together all the days 
John spent in school, the total might come to three years. We 
know that the family moved so frequently (at least eleven 
times in four years) that he could seldom have spent a full 
term in any one school. John was last in the fourth grade. 
He attended school in this grade irregularly for some years. 
Apparently he was not held from advancement on account of 
dulness, but because the mother went to the teacher and said 
" Don't waste any time over this boy of mine. He is feeble- 
minded and will never learn, no matter how much effort you 
expend on him." Apparently, also, the teacher believed the 
mother who was so candid about the failings of her son, ac- 
cepted her advice, and spent her energies on the other children. 

As might be expected under the guidance of such a mother, 
home life was not an aid to John's mental development. Julia 
says that her earliest remembrances are of squalid surround- 
ings, a room or two with the poorest of furnishings, which 
were never anything but filthy. She had very little clothing, 
and at times such a small amount that she was forced to stay 
indoors. John says that his mother would buy him new 
clothes and then lock them up till he had outgrown them. 
Moreover, there was never enough food, and the children were 
continually hungry. The mother and step-father beat Julia 
and obliged her to chop wood and do all the work. In her 
presence they also indulged in perverse sexual practices. John 
was not abused to the same extent, probably because he was 
the father's own child. However, the only attempt to teach 
him an3rthing was his father's instruction in obscene verses 
and songs. 

John and Julia had not even the opportunity to leam from 
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contact with other children. Their mother often kept them 
in the house, and this happened still more frequently after the 
father deserted. Even when the mother was away scrubbing 
in the middle of the day, the children dared not venture out, 
for fear there might be some truth in their mother's state- 
ments that " there was a God lover head " who would do var- 
ious things to them, that the policemen would get them and 
do terrible things, that people would kill them, and later, when 
Julia was living elsewhere, the mother told John that "they 
would catch him in the draft" — a hazy, but horrible fate. 

John's story of his life is of a succession of moves from 
house after house, with periods of confinement varying from 
a few days to one that lasted 13 months. Most of the day- 
time he slept or amused himself by reading the Bible, the few 
religious books and the few Indian stories which they owned. 
When the mother returned from her work, he seems to have 
been occupied with endeavoring to escape her wrath. He says 
that she would ask him questions and then answer them her- 
self. If he attempted a reply, she usually slapped his face. 
She talked continually of the references which the newspapers 
made to her, and of the pictures the moving-picture men were 
taking of her. They had no regular meals. The mother prob- 
ably ate something at the restaurant where she did scrubbing, 
but all she brought home to John was bologna sausage, milk, 
crackers, and bread. When he came to this hospital, the boy 
had not had a hot meal in months. At night he was often kept 
awake bv his mother's talking, by what he called "Mother's 
lies." 

Things went from bad to worse with John, but they im- 
proved for Julia in the spring of 1917. At that time the 
mother accepted a position as " an experienced cook " and 
took the children with her. On the third day she was dis- 
charged as dirty and hopelessly incompetent. Julia, however, 
was retained and since that time has had normal surroundings. 
John and his mother returned to their squalid living, and the 
boy was confined even more closely until early in 1918, when 
the police and one of the children's societies found them and 
brought them both to this hospital. 

When John was examined here, he was a large, overgrown 
boy, sallow and anemic. His voice was husky and uncertain. 
He did not know how to meet strangers, and was shy and re- 
served. His face was a little sober, but almost expressionless. 
He smiled slightly and then only after many interviews. He 
answered all questions as briefly as possible. The most sur- 
prising thing about his attitude was that he took practically 
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no interest in his surrotmdings or in what was to happen to 
him. John's ignorance of the world about him was astoond- 
ing. He could name the president, the governor, and several 
recent mayors, but when asked for the capital of Massachu- 
setts he did not understand what was meant He knew nothing 
whatever of geognq)hy. With the exception of reading, arith- 
metic was tte only school subject in whidi his performance 
was at all creditable. He had never seen a moving picture or 
a baseball game. 

We have here, then, a boy of fifteen and a half, who has had 
practically no school training, practically no contact with 
other children, and no home education save what he may have 
picked up from the reading of a few religious books, and per- 
haps a stray copy of a newspaper. 

In spite of this overwhelming lack of information and of 
training, when given a psychological examination John re- 
ceived a mental age of 16.0 (I. Q., 1.04) on the Yerkes- 
Bridges Point Scale, and a mental age of 15 yr. 1 mo. (I. Q., 
.98) on the Stanford Revision lof the Binet. There is nothing 
in the examinations that would be unusual in a normal boy of 
his age. On the Point Scale the errors he made were in: 
repetition of 7 digits, repetition of the longest sentence, failure 
to give interpretation for two lof the pictures, failure to give 
definitions in terms of classification, acceptance of the line 
suggestion, failure in one of the memory drawings, in one of 
the definitions of abstract terms, and in one analog)'. On the 
Stanford scale, he passed all the 9 year tests, failed in designs 
from memory in year 10, in interpretation of pictures in year 
12, in the vocabulary in year 14 and the succeeding years, in 
giving differences between abstract words, in repeating back- 
wards, and in the code in year 16, and in the repetition of 
digits forwards and backwards and in giving the thought of 
a passage in year 18. His arithmetical ability is particularly 
evident in the Stanford examination. He did the Healy Con- 
struction Puzzle A in 7 moves in 15 seconds and Construction 
Puzzle B in 12 moves in 30 seconds. His attitude during the 
psychological examination was somewhat listless and a bit 
childish, but he cooperated well and showed occasional interest 
and pleasure. 

The conclusion must be that, in this case, at least, lack of 
school-education, lack of home-training, and lack of normal 
intercourse with other children have not prevented a normal 
rating on intelligence scales. 

John's subsequent history, while not of consequence for our purpose, 
is, nevertheless, interesting. He was discharged from this hospital 
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to a society for placing and caring for children, with the diagnosis 
" Not Insane, not Feeble-minded." We hoped that it would be possible 
to give an examination at the expiration of his first year of living in 
normal surroundings. This proved inadvisable because the boy is 
doing good work on a farm, and a trip to the city might encourage 
his present ambition to work in a store, a job which doubtless would 
not fit him just now. The society, however, sent us a detailed report 
of a " visit " made and we give the substance of that report here : 

John is living on a farm with a family who understand his case and 
are anxious to assist him in every way possible. He has gained in 
weight since last year and he looks physically well. However, he is 
very slow in his movements, and appears to take no interest in his 
surroundings. He seemed little affected by the fact that the visitor 
had come from Boston to see him, and the family say that this is his 
usual attitude. In the year that he has been with them, he has never 
spoken of his mother and sister, has never asked questions about 
places to which he has been taken in the automobile, or shown any 
interest in them. The only exception was one trip to the ocean, when 
he asked "Why can't you see the other side?" But he has never 
spNoken of the trip since. His tjrpical day is as follows: Rises at 6, 
without being called, feeds the horses, without being told, milks three 
cows, comes into the house for breakfast, without being called, 
eats a hearty breakfast, then without any comment, returns to 
work, waters the cows, and cleans up the bam. He comes back 
to the house about meal time, gets the mail from a box at the end 
of the lane without reading any addresses or ever asking if there 
is a letter for him. After the noon meal he takes care of the hens, 
and does odd jobs. In the summer time he goes for the cows. After 
supper he reads the jokes in the daily paper and Farm Journal, some- 
times smiling a little. He never grumbles while doing anything he is 
asked, never asks a question, very seldom speaks without being spoken 
to, goes to bed without being told to at 6:30 and is perfectly willing 
to do this day in and day out. In fact, far from disliking routine, he 
is somewhat disturbed when rain prevents the performance of some 
of his usual chores. He shows no interest in anything. He is good 
to the animals but never pets them and the dog and cat never ask him 
for food. He never notices anything unusual. If, for example, a 
cow were in great distress and he had not been told to notice whether 
or not the cow was sick, he would make no comment. Neither is he 
at all interested in the fact that the farmer is willing to give him $50 
if he remains with him a full year. Besides this total indifference, 
the farmer and his wife have reported several facts which are of 
importance in the prognosis of the case. He has recently been smiling 
more often, and occasionally laughs heartily when alone at his work. 
When asked what he was amused at, he insists that he did not laugh. 
He has never made any attempt to play with a boy who lives in the 
next house, a quarter of a mile away. It seems likely that the boy 
may end by having Dementia Praecox, like his mother. 
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I. THE "COACHPROOF" TEST 

1. The " clinic rounder/* vitiating Binet findings by previous 
experience of the tests, early demanded the protection of 
such measurements against foreknowledge. As mental exami- 
nations are introduced in various kinds of personnel selection, 
and it becomes increasingly to one's interest to make a good 
score, protection against coaching in the n^ethods used becomes 
altogether necessary. 

2. A test is " coachable " to the extent that superior specific 
ability in it may be acquired through practise in it, or through 
knowledge of the result to be attained. Tests of involuntary 
processes are least subject to coaching. Sensory tests are 
somewhat coachable, though it is questioned whether the im- 
provement is in strictly sensory acuity, or in more efficient 
use of accessory cues. Voluntary motor tests are coachable 
to the extent of practise improvability, which may be consider- 
able if not rapid. With well designed experiments, the prac- 
tical danger of coaching in these fields is not great. The dan- 
ger of coaching is greater in the higher mental processes, where 
right response is determined by factors of conscious knowl- 
edge. One simply learns that he is to speak certain words or 
draw certain lines, in response to particular problems. While 
such coaching may be unmasked in individual examination, 
it is none the less vitiating thereto. In group experiments it 
is less likely of detection. 

3. There is little protection against special ability acquired 
by practise in the actual motor or sensory tests. Protection 
against coaching in tests of the higher mental processes is 
provided through alternative tests of similar material, but so 
differing that the literal responses to one are not correct to 
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another. Tests with a number of homogeneous alternatives 
are for practical purposes regarded as commensurable and 
coachproof. 

4. Though essential test elements are changed in the alter- 
natives, they preserve common factors open to mutual practise 
effect. Such tests are still coachable to the extent to which 
practise in any one form of the test will improve performance 
in its alternatives. In this way is measured the degree to 
which a test is coachproof. This problem is essentially the 
not unfamiliar one of practise and transfer. 

5. In the course of preparing material for coachproof in- 
struments of mental examination, inquiry was made into the 
perfection with which the method of alternation attained this 
purpose. Ten alternative forms of the Woodworth-Wells 
hard directions test were prepared.' A subject accomplished 
one of these and one of the Woodworth-Wells standard blanks 
daily for ten days. On odd days the standard form preceded, 
on even days the alternative form. Then ten standard blanks 
and ten alternative forms were on the same day accomplished 
in immediate succession. There was thus practise in an iden- 
tical task, paralleled by practise in a continually changing task. 
Evidence of coachability in the test is the appearance of prac- 
tise in performance with the alternatives. 

6. The score is in seconds' time. For each error, the time 
consumed is increased by 1/15 of itself (there are 15 responses 
in the test.) With this correction for error, the initial time of 
the standard form is 92 seconds, of the alternative form 94 
seconds. Figuring these starting points as 100 per cent, the 
per cents of each reached in the subsequent tests are shown 
in the accompanying curves. 




Alter n«t« 



* For illustrations, cf. Joum. AppL Psychol., 191 7, vol. i, p. 139. 
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7. Both standard and alternative tests show significant prac- 
tise improvement at the end of twenty performances. The 
best performance in the standard test is 24 per cent of its 
original score. The best performance in the alternative test 
is 40 per cent of its original score. The subject's performance 
at the beginning is about the normal average. After practise 
periods totalling less than an hour the alternative forms are 
accomplished in time near the lower limit of the unpractised 
normal range. A test having this property is not well fitted 
for use where there is special motive to make a good showing, 
and normal opportunity to train therefor. 

8. Other experiments were made in which the practise was 
not obtained from day to day but in immediately successive 
performances. Practise was given in a " constant increment " 
test, adding 17 to each of a series of 10 two place numbers. 
Time and errors of each series were noted, the experiment 
consisting of 45 series. The first three series were diflferent, 
and average 36 seconds without correction for one error made. 
The third series was then practised for seven records, without 
error, the time decreasing to 21 seconds. The subject having 
then studied for 3 minutes to learn the series, practise was 
continued to the fifteenth record without change. Then new 
series (Nos. 4-8) were introduced for five records. They 
were accomplished without error, in average time of 29 
seconds. Then series Nos. 1-8 were repeated (records 21-28). 
Series 1 and 2 showed about 68 per cent of their beginning 
rate, the others were longer than their previous records. 
Record 29, a wholly new series (No. 9) is 28 seconds and 
errorless, clearly better than initial performance. Practise 
being resumed on series No. 3, (records 30-35) the subject 
was requested to memorize this series and report when done, 
(224 seconds). The errorless time dropped to 14 seconds. 
Records 36, 37, new series, have 68 per cent of the initial 
score; 38 is very long, apparently blocked. In the remaining 
records, 39-45, series 1-7 are used with the addition of 16 in- 
stead of 17. Practise improvement begins to show at the 
close of the experiment. There was subjective feeling of 
" ready to stop," as though doing slowly. 

9. Continuous experiments like this are objectionable as in- 
troducing a fatigue (refractory phase) element not present in 
practical application of the tests. This tends to mask gains by 
transfer. On the other hand, there is an accustomedness to 
the whole physical setting of the experiment that is helpful, 
but absent in the conditions of practical application. A some- 
what more satisfactory situation is indicated than in the hard 
directions test. The best performance with the same incre- 
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ment in a new series is 74 per cent of initial performance. 
The best performance in the practised series is 41 per cent of 
initial performance, representing the time of writing a memor- 
ized series. When the increment is varied (adding 16 instead 
of 17), the gain is practically neutralized. 

10. Another subject accomplished 40 records in a constant 
increment test from a single series, No. 4. In these records 
different increments were added to the series. These numbers 
added ranged from 3 to 19. The increment in the initial series 
was 14, and during these 40 records this number is not so 
employed again. In records 41-50, the increment 14 was added 
to series No. 4 in all cases, thus giving practise on this series 
and number only. In records 51-60, 14 was added to different 
series, save that the last two records were again with series 
No. 4. 

11. The score is the time consumed for a series, plus 10 
per cent thereof for each error. These scores for the 60 
records are shown in the accompanying graph. Attaching to 
each point of the curve for the first 40 records is a special 
figure. This denotes the figure added in that record. In 
records 41-60, 14 is always added ; to the same series in records 
41-50, to different series in records 51-60. 




W 






some series «A^^ir^ ^MvAI* 
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12. The practise in adding other figures to series No. 4 
does not appear to increase facility in adding 14 to series No. 
4. In records 41-50, the repeated adding of 14 to series No. 4 
rapidly improves capacity in that specific function. In records 
51-60 it is not evident that the previous 50 records have im- 
proved the adding of 14 to any other series than the one used 
in those 50 records. It results that practise with the same 
series and the same increment gives great improvement. Dif- 
ferent series with the same increment give some improvement. 
The same series with different increments gives very little if 
any improvement. In practical experiments it is easy to vary 
both series and increment. It is indicated that superior capa- 
city for an unforeseen series and increment is not to be gained 
save through a generally increased capacity for all series and 
all increments. A test with this property is coachproof . 

13. Other experiments were performed in which the task 
is the rearrangement of various items in a serial order. A 
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subject was instructed to rewrite in order of magnitude a 
series of ten 4 and 5 place numbers. The first two records 
were with different series. Series No. 2 was then practised 
until the tenth record. The 11th record was a new series. 
Practise was continued with Series No. 2 until the twenty-first 
record. Nine new series were then introduced, making thirty 
records in all. 

14. The score is the time in seconds for accomplishing a 
series, plus 20 per cent of itself for each break in the series, 
plus 10 per cent of itself for each lapse in writing. Fourteen 
out of the thirty records taken were penalized for error. 

15. Records 1 and 2 are errorless and average 46 seconds. 
The last two errorless practise records, (19 and 21) average 46 
per cent of this score. The last two errorless new series, 
(records 25, 26), average 40 seconds, 87 per cent of the initial 
score. The final group of new series, (records 22-30) aver- 
ages 130 per cent of the original score, so heavily were they 
penalized for errors. No marked gain in the accomplishment 
of new material is indicated. 

16. In a subsequent experiment the procedure was changed 
in that the subject instead of writing the series itself in order, 
numbered the items to show the proper order. 

17. The score is the time consumed in accomplishing a 
series, plus 20 per cent for each break in the series. Of the 
25 series accomplished, 14 are without error. 

18. The initial time is 35 seconds, the score being raised by 
one error to 42. The responses improve quickly through 
memorization. The seventh record is 19 per cent of . the 
original score, beyond which no improvement is observed. The 
best score in a new series is 52 per cent of the original score, 
(record 17). The best score in a new series penalized for 
error is 73 per cent of the original (record 21). It is indicated 
that the practise effects some general improvement ; less coach- 
ability appears than in the hard directions test and more than 
in the constant increment test. 

19. In another subject, the experiment was performed not 
with numbers, but with names to be numbered in order of 
alphabetical sequence. The first two records were with differ- 
ent series. Series No. 2 was then practised until the ninth 
record. The tenth record was a new series. Practise with 
series No. 2 was then continued until and including the 
twentieth record. Ten new series were then introduced, mak- 
ing thirty series in all. 

20. The score is the time in seconds for accomplishing a 
series, plus 20 per cent of itself for each error. Six of the 
thirty series were thus penalized. 
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22. The improvement in the practise series is to 15 per 
cent of the original score. The best score in a new series is 
55 per cent of the original score, (record 30). The best score 
in a series penalized for error is 65 per cent of original score 
(record 22). Similar coachability to that with the consecutive 
numbers is indicated. 

23. Attention is invited to already reported results on prac- 
tise with the free association experiment.^ With no repetition 
of stimulus words there are general decrease in time, and 
other improvements of performance. Records of this test 
may be vitiated where there is motive to attain high degree of 
practise. There are also certain instructions about responding 
whose observance would improve the score if not unmasked 
in lengthened times and the character of responses. 

24. The number-checking test ^ employed in connection with 
the above association experiments is not alternative and thus 
without significance for the present question. The addition 
material (Kraepelin's Rechenhefte) is alternative and shows 
considerable practise. It is not probable that the subjects' 
general quickness at figures is increased so greatly if at all. 
For quickness at figures, such a test is invalidated in special 
practise, the increased capacity being confined to a particular 
and practically unusual sort of adding. 

25. Such a test of adding is very analytical; it does not 
cover the field of quickness at figures, but a specific part of it 
which will normally be an index of the whole. If a subject 
is specially practised, this relation is distorted. As an analytic 
test, a test is " coachable " in any form in which it shows prac- 
tise improvement. 

26. Alternative " typewriting tests " are coachproof in 
spite of their practise improvement, because such improve- 
ment applies more equally over the general accomplishment 
of typewriting. Instead of analysis, the typewriting test aims 
at synthesis, that is, at reproducing in miniature as much as is 
possible of the practical accomplishment. Where, as in type- 
writing, a reasonably synthetic test can be made, " new " test 
material is also coachproof. 

27. The practical significance of mental tests, except the 
specifically " trade " tests, is analytical. It is indicated that 
alternation leaves certain tests open to not inconsiderable prac- 
tise improvement. Such tests can still be " beaten " where the 
practical motive is sufficiently strong. f L w 

2 Practice Effects in Free Association, Am Jour. Psych., igii, vol. 
22, I -13. 

^Relation of Practice to Individual Differences, Am. Jour. Psych., 
1912, vol. 23, 75-88. 
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IL A FILING TEST 

28. The essential operations of filing are searching the files 
for a given entry, and filing a new or removed entry in the 
file. Efficiency of file clerks is given in the speed and accuracy 
with which these operations are accomplished. 

29. The part played by memory, patience, and general intel- 
ligence in this accomplishment, increases with the complexity 
of the files to be handled. The filing test proper is concerned 
with specific aptitude in the psychomotor processes of 
manipulating the file. The task is to find the place where a 
given entry is or ought to be. 

30. A testing file of 500 cards, 2j/$ by 3 inches, contained in 
a standard file drawer, was furnished for the present purpose 
by the Phoenix Mutual Life Insurance Company. 

3L For the test of searching fifteen cards at random were 
removed from the file, and five other names in it were noted. 
All twenty names were written on a single sheet, which was 
handed to the subject, with instructions to find whether the 
names were present in the file or not. If the name was found, 
this was announced by speaking the name; if not, the an- 
nouncement of the name was preceded by the word " No." 
Another procedure was to have the names writen one each 
on memorandum slips and have the subject verify them as 
above. This made it possible to present the same names in 
varying order. Each operation was timed with a stopwatch. 

32. For the test of " filing " proper, twenty cards at random 
were removed from the file. They were given to the subject 
with the direction " File these cards in their right positions. 
Let them rest simply on the rod " (the locking rod as shown) 
" without removing the rod and pushing them down into 
place." The time of filing each successive name was noted. 
Afterwards the subject might be asked to check the correct- 
ness of the cards just filed, a process taking from 50 to 170 
seconds. The correctness of the filing was verified before re- 
moving the locking rod and returning the cards to their final 
positions. 

33. Results from eight subjects are as follows : 

Average time in Seconds in Elementary Filing Operations. 

Subject ABCDEFGH av. "m.^* 

Searching 15 21 25 19 35 25 19 18 22.1 .21 

Filing 25 17 14 19 37 26 17 15 21.2 .28 

34. The first five subjects are without special practise in 
office methods; the last three are office secretaries, but not 
professional file clerks. There is evidence that such times as 



Digitized by 



Google 



PSYCHOLOGICAL LABORATORY OF Mc LEAN HOSPITAL 179 

the above are much reduced in special training. There is gen- 
eral correspondence in the speeds of searching and filing, 
which is confirmed in office experience. Subjects A and C 
however, are quick in one operation and slow in the other. 

35. Final scores are stated in terms of time. Errors do not 
essentially affect the present results. In general experimental 
practise, it is best to correct a time score for errors through 
increasing it by a percentage of itself. Heavy penalty is to be 
imposed for errors in a filing test, such as ten per cent of the 
time score for each per cent of error. 

36. File manipulation is influenced by external factors such 
as the number of names in the file and their dispersion 
through the alphabet. The names in the present file included 
but a small fraction of the letter A. A file with the same 
number of names but running throughout the alphabet, would 
probably be easier of manipulation. 

37. The above represents a standardizable form of test for 
filing operations proper. It is coachproof. It was in the 
present instance applied as an individual test, but is convertible 
into a group test with sufficiently extensive testing files. 

F. L. Wells. 

III. A BRIEF TEST FOR MENTAL ACCURACY 

38. It was desired to arrange series of tests which should 
be (1) coachproof, (2) suitable for application to groups, (3) 
applicable to individuals with less demand upon the experi- 
menter's attention than time-limit group tests. This and the 
following studies deal with tests so arranged.^ In practical 
application these tests are most suited for the selection of 
clerical workers. 
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est number on the dotted 


the ritht of 
thus 10 27. 


each number \ 






line at the top, and the 








others in order of site 










below it. 


^€i 


31.. ^.f 






8846 


79.. ^i. 


48. .^A. 




761 ) 195577 


9059 


88. /ix 


66.. r2. 






10604 


68. yy. 


26. J5. 






10653 


25... i.'^. 


98./i7. 

37. .i>. 






10097 


w.ii 






10578 

10585 


^::JfI 


13.. f.^. 

Si • V'- 






8605 






7895 


23../9.0. 






8813 



*A brief time limit intelligence test was also devised, described by 
G. G. Femald. Report of the Maine Commission for the Feeble- 
minded, 1918, pp. II, 75. 
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4. On the dotted lin* btfore the name coming 
first in alphabetical order, write the figure 1; 
before the name next in alphabetical order 
unite the figure 2; and so on until you write 
10 before the name last in alphabetical order. 
Foley. Annie E. 

Gates. Mary M. 

Kennedy. AUan T. 

Mac Donald. Alice J. 

Robertson. Qara L. 

MacDougaU. Vincent 

Judge. Mary 

Mingo. Ida L. 

Marden. Edith 

Roberta. Fannie 


5. Copy the numbers giwtn below, puUing 
them on the dotted lines at the right in the 
same order as they are given. 

514863729 

169472853 

384259617 

837594162 

392617584 

471862953 




A 


B 


C 


D 


E 


F 


G 


H 


J 


K 


L 


M 


N 


P 


Q 


R 


S 


T 


U 


W 


6. Fach of the squares in 
the diagram at the left is 
named according to thet 
letter under which it stands 
and the number on the 
same line with it. Thus 
tht square with an x in 
it is named B3. 
Giee the letter and num- 


1 










































2 










































3 




X 






































4 










































5 




c 






































which haee in thtm the 


6 


n 








































t....;g....:n 


7 








8 


































Putafiiure 6 in squareYf2 

.. 2 " " F3 
• 7 •• •• G4 
- 4 .. .. j7 


8 










































9 






























t 












10 




































f 





















































7. Do vohat it says to do and be sun you get just tvhat it says. 

If New Year's comes in Maj^^make a figure 6 here ; but if not 

tell where the sun rises. .J^.Qi/t^. . . Give a wrong^answer to this ques- 
tion, * How many days are there in September?' T^v^ Write " no no 
matter whether Canada is in Africa or not. .<y^ Write the seccmd 
letter of your first name and the first letter of your last name at the be- 
pnning of the dotted ]me.u<?H^ Notice the numbers 2, 7— If iron 
IS heavier than water, write the smaller number here. .^; but if iron is 
lighter, write the larger number here — If people believe that Columbus 
was King of England, cross out what you last wrote, but if not, put in 
the number to complete this senteice, ' A cat has . jS^. ears.' If Friday 
comes after Thursday, make two crosses here. .i. ^ . . ; but if not, make 

a square here or a circle here Give the correct answer, 

" ves " or " no," to this question, ' Do apples have four comers?' .OvC- • • 
Write again what you last wrote, here. . ."A^. Make a comma after 
the shortest of these three words, hat^ pill ladder. Put a square before 
this name of a boy. . O. .John. Write any letter except 'V' just after 
this comma, .Os^. Make a dot to the right of any one of these letters 
F G H L J. Show by a cross when the days are shorter: in winter?. ^ . 

in summer? Write " no " if 2 x 6 are 12. .Qw#; if not, make a circle 

here 



39. The present study concerns the first of these test-series, 
termed C. A form of it is reproduced herewith. It is seen to 
be capable of indefinite alternation. Actually ten forms in 
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addition to the above have been printed, omitting however 
test 7, the alternative of the Woodworth- Wells Hard Direc- 
tions test. 

40. It is intended that the problems of this test-series shall 
all be well within the range of the subject's information and 
experience. The quality of performance then depends in first 
instance upon the care with which the tests are accomplished, 
not upon special information of correct answers or ability 
to reason them out. In subjects for whom the series is suited, 
performance is limited essentially by the subject's carefulness. 
Other test-series are limited by knowledge and by reasoning 
ability. 

41. For accuracy the tests are scored as a point scale. The 
sum of possible credits is 100. E^ch item represents a pro- 
portional part of these credits. Deductions therefrom are 
made for errors uncorrected. In tests 3 and 4, a deduction 
is made for corrected errors, which is doubled for uncorrected. 

42. A rational final score in tests of this nature, or any 
function thereof, is the per cent of all records in file which 
the record in question surpasses. If it is the best of all 
records, it thus scores 100 per cent ; if better than half, only 
50 per cent, etc. A card file of results is kept, in which each 
new accession to the data is entered in order of its amount of 
credit. 

43. The present data concern 140 individuals; 75 records 
from college students, 53 from high school students,* the 
remainder from adults of the same order of intellectual 
capacity as these. From the college group, the per cents sur- 
passing different scores in points earned, and in minutes of 
work, are as follows : 



Point Score 


Per cent surpassed 


Time for test Per cent surpassed 




by same 


(min.) 


by same 


20 





22 





30 


1 


20 


1 


35 


3 


19 


4 


45 


4 


18 


8 


50 


11 


17 


13 


55 


17 


16 


20 


eo 


24 


15 


28 


65 


•29 


14 


38 


70 


40 


13 


53 


75 


52 


12 


67 


80 


61 


11 


82 


85 


73 


10 


94 


90 


84 


9 


98 


95 


90 


8 


99 


100 


97 







^ For this material the writers are indebted to the courtesy of Dr. 
H. T. Woolley. 
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44. With the high school group, the time score was in 
terms of points earned per minute of work. In this group, 
percentile values of various scores are approximately as 
follows : 



Point Score 


Per cent surpassed 


Points earned 


Per cent su 




by same 


per minute 


by sa 


31 





1.0 





40 


8 


1.5 


4 


50 


15 


2.0 


4 


55 


19 


2.5 


7 


60 


32 


3.0 


19 


65 


40 


3.5 


32 


70 


47 


4.0 


45 


75 


54 


4.5 


60 


80 


60 


5.0 


68 


85 


74 


5.5 


79 


90 


83 


6.0 


87 


95 


93 


6.5 


91 


100 


96 


7.0 


95 






7.5 


98 



45. When graphs of scores for both groups are superposed, 
there is evident no separation of the groups in respect to 
number of points earned. The ranges of performance are 
similar in extent. The number of points earned per minute 
is clearly greater in the college group. Their superior mental 
discipline enables them to perform the operations faster, but 
they are accomplished with equal accuracy in both groups. 

46. The accompanying table analyses the error penalties in 
different tests of the series. 



1. Addition 

2. Long Division 

3. Consecutive numbers. 

4. Alphabetical names. . . 

5. Copying 

6. Letter-square 

7. Directions 

47. As is consistent with paragraph 45, the different items 
are of nearly equal difficulty for the high school and college 
groups. 

C. M. Kelley, 
F. L. Wells. 



Per Cent Make 
No errors 

48 


NG 

1 


error 

25 
21 
21 
14 
4 
19 
36 


2 errors 

10 

6 
15 

8 

3 

3 
21 


3ormore 

errors 

17 


73 




44 

50 

93 


20 
28 


60 


18 


27 


16 
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IV. THE " CUED COMBINATION " METHOD 

48. The present study deals with performance of high school 
and college students as indicated in paragraph 43. The test- 
series is termed K, the form used being reproduced on the 
page opposite. It employs a variant already described^ of 
the combination method, and is a preliminary form of the test- 
series, to which similar alternatives have been prepared. 

49. The first portion consists of words 35-70 inclusive of 
the Terman Vocabulary Test, omitting the words stave, snip, 
and swaddle. The cues in this portion are intended to be 
such that the word cannot be supplied unless known. The 
second portion contains words of special difficulty in spelling. 
The cues for these words are intended to indicate the word 
clearly, without indicating its correct spelling. The third 
portion presents another kind of material, and is discussed 
subsequently. 

50. This test-series differs from series C in that it is limited 
by the subject's absolute knowledge of correct responses rather 
than by his carefulness in setting them down. Carelessness 
is less likely to vitiate what is known here than in series C, 
because there are more logical connections by which responses 
check themselves up. Carefulness adequate to perfect score 
in series C avails nothing for the responses of series K out- 
side the range of knowledge. Practically, this type of test- 
series is indicated where clerical duties take on a secretarial 
nature, more intellectual than reached by the mechanical tests 
of series C. 

1. Each of the sentences below has a ward of which only certain letters are 
given. You are to fill in whatever letters are missing so that the word is 
complete. If you are not sure you have filled it in rightly, you nu^ put a 
? after your answer. If you cannot fill in a ward in about 15 seconds, go on 
to the next. 

Each period (. ) in a word means one letter left out; a long dash ( ) 

means any number of Utters left out. 

Examples: 
The boy was sucking a big ripe or. . .e (orange). 
A cent is made of co (copper). 

This policy will .ns. . . your house arainst fire. We r.g. .d your 
idea very fiavorably. The dentist was obliged to kill the n — of the 

toodi. We heard the carriage-wheels c. .nch the gravel. The j r 

kept six balls going in the air at once. The judges in their robes repre- 
sented the m. . .sty of the law. She is of a deep brun complexion. 

He copied his superiors in an a. .sh manner. The pup is a sp. .ti. . , 
frolickmg little animal. She laughed herself into h cs. M. . . was 

5 Joum, Appl. Psychol, 1917, Vol. i, p. 140. Joum, Educ. Psychol., 
1917, Vol. 8, pp. 433'437- 
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the Roman war-god and is the name of a star. He left to seek r.p. .e 
from his labor. You are too shr. . . to be tricked by such talk. Who 

loses the game must pay the f . . f . . t. He has a marked p. c ty of 

speech. The c ge of 2^ cent pieces has been thought of by the govern- 
ment. The table was inlaid with beautihil mos. . . designs. They ceased 

to bew. . . their misforttmes. The labor of doing that is disp nate 

to the good it does. The house, old and d. . . p d, is still an interesting 

ruin. The company was granted a ch r by the state. He is very 

con — n. .ous about always doing his best work. The greatest fault of 
the miser is av e. The story was told with ar s childlike sim- 
plicity. These records are pr ess, and must be kept with greatest 

care. We will t ate these abuses no longer. It was a g. . .t.nous 

mixture, soft and elastic. The North Cape is a high p ry extend- 
ing into the Arctic Ocean. Food in camp must be guarded against the 

d d.tions of squirrels. His designs have been learned in time to 

f. .str. . . them. He is a weakling, a m. .ks.p afraid of all hard work. 

He was devoted to ph py, and gave much to his home town. He 

spoke with bitter i ... y of the abuses he had seen. 

This work is the crowning a ment of his career. The shipment 

is due day after t . This article is ind.sp — ble to all house- 
holders. We cannot allow a further cont — nee of this practise. You 

will super. e. . him in the control of the job. Be the first to s these 

exceptional opportunities. Several men pre ded him in this 

obsdiration. A musty odor will nate from disused cellars. It 

is our b ness to see that the work is well done. The letter 

was not at hand because the boy had f ^ten to mail it. To su 

in life erne must apply himself steadily. We should be guided by the 

same prin in all these cases. She met her fian at the railway 

staticm. We have received mon s amoimting to over $7000. This 

is a sad oc nee, which will not happen again. The two sep- 



firms will unite to form one. We are ref to you by your frigid, 

Mr. John Robinson. This process will ^im.nate waste and result 

in great saving. 

2. Below are names of towns and cities in the United States. After each 
name, write the name (or abbreviation) of the State in which thai town is, 
1/ the same name is given more than once, give a different state for each time 
tt is given. Indicate only the larger of the towns so called for, not smaller 
ones like Salem, Maine, or Rutland, Mass, 

Skip any you do not know, and go on to the next. 



Muskegon Duquesne Alexandria Camd^i 

Ansonia Newton South Bend Rock Island 

Walla Walla Himtington Peterson Chattanooga 

Hagerstown Bois6 Jackson Maiden 

Leominster Washington Jackson Pottsville 

Cambridge Washington Jackson Belleville 

Aurora Erie San Francisco. . . Oswego 

New Castle Berkeley Norwalk Kenosha 

Topeka Michigan City.. . 

51. For accuracy, the test-series is scored as a point scale, 
the sum of possible credits being 100. E^ch item represents 
a proportional part of these credits. Records were kept as 
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indicated for Series C in paragraphs 41 and 42. The question 
mark feature of the directions was without value. 

52. Percentile scores for the 75 college students and 53 high 
school students, for the entire test-series, are as follows : 



CoLLBGB Group 

Per cent Time of Per cent 
Pdint surpasaed test surpassed 
score by same (min.) by same 



41 
45 
50 
55 
60 
65 
70 
75 
82 




3 
8 
23 
44 
65 
82 
94 
98 



26 
22 
20 
18 
16 
14 
12 
11 
7 




9 
19 
43 
61 
76 
92 
96 



High School Group 

Per cent Points Per cent 
Point surpassed earned surpassed 
score by same per min. by same 



31 





1.0 





35 


9 


1.5 


8 


40 


25 


2.0 


28 


45 


45 


2.5 


53 


50 


59 


3.0 


73 


55 


79 


3.5 


83 


60 


93 


4.0 


91 


65 


98 


4.5 


96 






5.0 


96 






5.5 


98 



53. There is more separation of the college from the high 
school group in this test-series than in series C. The present 
test-series is of a type calculated to specially bring out the 
formal educational difference involved. The separation is 
somewhat greater in respect to total points earned than in 
points earned per minute. 

54. The accompanying table analyses the credits earned in 
the items of the cued combination test, all data being combined. 



Word 



1^ 




1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 

Correct. % 91 98 98 68 68 52 85 37 18 67 91 56 80 86 69 81 68 

Failure of 8pellizic.% 3004 21 10 11 1 1252 111 862 1 

Wrong word con^ned.%... 501208 16 115 363273219 20 

Omitted. % 12 183223 47 45553664248 11 



Word 




18 19 20 21222324252627282930 31323334 

Correct, %. . 73 47 2390435323587925 21 22 67 29 61 7929 

^ure of speUinc. % 14 51 137 12 1 1 1 836 11 7 1 6 3 3 

Wrong word combined. %... 732 1 18 14 74 21 864030 17 
Omitted, % 20 36 24 9 19 27 62 34 16 46 35 61 22 70 30 18 51 
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2 1 8 g f 




Woni 



11 

35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 

Correct. % 88 44 80 32 30 35 94 82 80 71 69 45 49 91 60 48 

Failure of speUing. % 1 52 17 36 15 31 6 8 11 4 25 22 48 7 22 13 

Wrong word combined, %... 62 1829 13 025246700 17 9 

Omitted. % 52224 26 21084 102632 130 

55. Special disparity, not shown with the tables, between 

college and high school groups is indicated in the words apish, 

gelatinous, depredation (s), achievement, seise. 

C. M. Kelley^ 
F. L. Wells. 



V. GEOGRAPHICAL INFORMATION IN HIGH SCHOOL AND 
COLLEGE STUDENTS. 

56. A list was made of towns and cities in the United States 
having population of over 15,000 by the 1910 census. The 
names were arranged in random order. The list includes 400 
names. Ten alternative lists of 34 names each were prepared. 
One of these is the basis of the present observations, its 
material being reproduced with paragraph 48. 

57. Responses were not scored correct unless they designated 
a town included in the population requirement, irrespective 
of there being elsewhere a smaller town as named ; (cf . Salem, 
Maine; Rutland, Mass.; in instructions.) As a test of infor- 
mation, it is simply of whether the larger town in question 
is known; further, it is not evident whether the designations 
of smaller existing towns represent actual knowledge thereof, 
or have only chance correctness. Credit is allowable however, 
for such responses as Lakewood, New Jersey or Plymouth, 
Mass., where larger but less widely known towns have place 
in the list; (Lakewood, Ohio; Plymouth, Pa.). 

58. The college and high school groups are considered apan, 
since the former is of Massachusetts, the latter of Ohio origin. 
This affects the results as shown in the following tables : 
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Town. 





9 10 11 12 13 14 15 16 17 18 



Correct. % CoUrae 11 5 13 3 73 97 12 6 4 93 17 94 3 37 57 59 4 

HiKhScbool.. 45 8 2 81 6 17 13 74 21 81 8 60 9 49 

Incorrect. % College 15 U 15 8 3 3 25 60 44 1 27 19 28 53 24 17 11 

High School 19 15 24 19 7 9 91 76 21 42 13 34 30 15 30 15 32 

Omitted. % Colk^ 74 83 72 89 23 0633438 57364 23 9 19 2485 

High School. 36 85 68 81 91 9 4 8 66 58 13 45 37 25 60 36 68 



Ills .? f> 

Town. 

19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34av. 

Correct. % College 29 69 4 16 11 97 13 1 40 9 53 96 11 3 33 4 32 

High School 64 36 8 26 1198 26 17 85 2 8 2 13 25 

Incorrect. % College 21 9 . . 42 . . 20 77 4134 32 120 12 24 9 24 

High School. . . 23 15 . . 37 . . 21 91 26 38 4 15 11 9 23 19 28 

Omitted. % Coltege 49 21 . . 48 . . 3 67 21 19 56 15 2 69 85 43 86 44 

High School.... 13 49 .. 47 .. 2 79 9 47 45 11 83 81 89 64 81 47 

59. Provincialism of response, favoring now the college, now 
the high school group, is shown in the items Muskegon, Newton, 
Huntington, Erie, South Bend, Rock Island, Chattanooga 
and Maiden. . This is the most important special factor in 
the results. Separation of college from high school as such 
scarcely appears outside the items Berkeley, Paterson, Oswego. 
The Massachusetts group is unduly favored by random 
selection from the large list, through the number of Boston 
suburbs thus included. It is indicated that the test items 
should not include the States where the test is made, or perhaps 
the States adjacent thereto. Towns listed in more than one 
State are also inconvenient. 

60. It is suggested that the ratio of right to wrong responses 
has an individual significance not included in the purpose of 
the test, concerning the reliability of the subject's " loiowledge," 
his critical insight into the correctness of his answers. The 
measure used is the per cent which the number of right 
responses is of the whole number of responses written. In- 
dividual differences are as shown in the accompanying distribu- 
tion: 
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Right Answers 

divided by 

AUAnswen .20 .25 .30 .35 .40 .45 .50 .55 .60 .65 .70 .75 .80 .85 .90 .95 
College Group 

Hiffh "school 
Grou] 



cMlegeCvnmp 

(75J 112548129685362 

' • School 

ip(53). 20727688454 



61. Group diflference is in the expected direction but is 
small in proportion to individual variability. The further 
education of the college group affects the criticism of this 
knowledge less than it does the capacity for cued combination 
responses. 

62. Among the mechanisms of wrong responses, is first the 
existence of other towns having the same name as that properly 
designated. Jackson, N. H. (9)*, and Camden, Maine (19) 
are prominent examples of this. The response Alexandria, 
La. (2) is virtually correct, 1915 census figures giving this 
town population of 18,000. (It is the only case of this kind.) 
Districts outside the United States are occasionally named; 
such responses may be fairly reasonable, as Alexandria, 
Egypt (2), or less so, like Topeka, China (2). Many varieties 
of autistic thinking are evident in the wrong responses, sound 
association among them. Duquesne is assisted into Iowa (7) 
by Des Moines and Dubuque. Boise owes the same location 
(14) to the resemblance of la. and Ida. Jackson finds itself 
in Florida (59) beside Jacksonville. Norfolk brings Norwalk 
into Virginia (12). Rock Island proceeds via Rockland, into 
Maine (20), and via Block Island to New York (12) ; it is 
also found in Rhode Island (3). A peculiar feature in the 
results is the placement of Chattanooga in New York (16), 
apparently through such media as Chautauqua, Canandaigua, 
Cattaraugus, Canastota. Other than directly sensory associa- 
tions appear responsible for the placing of Washington in 
Oregon (14). Berkeley, Mass. (16), has a partial determinant 
in the proximity to most of the subjects of Berkeley Street, 
Boston. Michigan City appears regularly in Michigan (112) ; 
but once out of 115 responses by 140 persons, in Indiana. 

63. There is no reason to regard such material as an " in- 
telligence " test. It applies synthetically to a restricted field 
of practical information. Illogical, "autistic" thought- 
processes are so prominent in the wrong responses as to sug- 
gest, anal)rtically, that these reflect a capacity for critical 
recognition of the " real." 

C. M. Kellev, 
F. L. Wells. 

• i. c. die response Jackson, N. H., was given nine times. 
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VI. AN OMNIBUS TEST FOR REASONING AND IMAGERY. 
64. Performance in the present test-series, (R) is limited 
by reasoning and control of imagery rather than by range of 
information or attention to mechanical detail. The form used 
is reproduced herewith. The first of its tests has had con- 









High SCHOOL Group 


Ptoint 


Ptrctnt 


Time 


Ptrctnt 


Point 


Ptrctnt 


PoinU 


Percent 


Score 


SurpaMed 


of 


SurpaMed 


Score 


SurpaMed 


Earned 


Surpatted 




by tame 


Test 


by tame 




by tame 


permin. 


by tame 


21 





27 

















30 





21 


1 


20 


6 


2.5 


17 


40 


1 


19 


1 


30 


17 


5.0 


43 


50 


9 


17 


7 


40 


27 


7.5 


73 


60 


23 


15 


9 


50 


38 


10.0 


91 


70 


24 


13 


22 


60 


53 


12.5 


96 


80 


45 


11 


46 


70 


57 


15.0 


98 


90 


66 


9 


74 


80 


72 






100 


95 


7 


91 


90 


85 










5 


98 


100 


98 







siderable development elsewhere. The latter two are derived 
from the Stanford scale. It was desired to examine their 
adaptability to group testing. Ten alternative forms of the 
series were prepared. 

65. In the clock tests the subject should not have access to 
a watch or clock face. One group of the high school students 
was able to see a large clock during the experiment. Their 
results are not improved over the others. 

66. Scoring and recording were as described in paragraphs 
41, 42, 51. Percentile scores for the college and high school 
students are as follows : 

67. There is less difference of the college and high school 
groups than in series K, and more than in series C. As in 
series K, separation is more marked in total points earned 
than in points earned per minute. 



1. In each line every number differs 
from the one before it by the same 
amount. On each dotted line write the 
number that will come next in the 
someway. 



280, 273, 266, 259. 
378, 386, 394, 402. 
276, 280, 284, 288. 
232, 224, 216, 208. 



2. Fioire in your mind where the 
hands of the clock are when t/ is 3:36 
o'clock. Now when the hands have 
changed places (so that the small hand 
has gone where the large hand was, 
and the large hand has gone where the 
small hand was), what time is it 

then? 

What time is it when 
If it is the hands change places 

8.13 

12.41 

10.19 
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3. A doctor must measure out ex- 
actly 3 ounces of medicine for a man 
who is sick in the woods. He has only 
a 2 ounce measure and a 5 ounce 
measure. Show how he can use these 
measures to get just the right dose of 3 
ounces without any guessing. He 
pours from one measure to the other, 
and what he does not want, he pours 
back into his medicine bottle 



How would he measure out 2 ounces 

with a 3 ounce measure and a 

4 ounce measure. 



How would he measure out 1 ounce 

with a 2 ounce measure and a 

5 ounce measure. 



68. Accompanying table analyses the credits earned in all 
data obtained with this series : 

Perfonnance Test 1 2 3 

Per cent Making Perfect Score 61 50 25 

4 error 22 

1 " 17 32 15 

14 " 3 

2 " 7 7 5 

3 " 3 4 26 

4 errors, and omissions 12 7 4 

69. No group difficulty appears with the clock test beyond 
preventing the consulting of watches and clocks. In test 3, 
(ingenuity), failures are largely due to "guessing", i. e. such 
responses as " fill the 3 oz. bottle half full," and the like. It 
may be questioned whether more emphatic instructions against 
this should be given. It is believed that to be satisfied with a 
"guessing" response in the present experimental setting, 
denotes essentially significant failure to grasp the problem. 
The test involves more writing than is desirable, otherwise is 
suitable for group presentation. It shows some notable separa- 
tion of college and high school groups, perfect score being 
made by 38 per cent of the college and 4 per cent of the high 
school group. 

C M. Kelley, 
F. L. Wells. 
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VII. CERTAIN INDIVIDUAL RECORDS COMPARED WITH 
STANDARD FILE. 

70. In the previous studies the chief concern has been with 
college and high school students, that is with persons who 
have not in general made an independent adjustment to life. 
In the present study a comparison of their records is made with 
a few individuals who have made such adjustments, at various 
levels. The findings throw light on what capacities in these 
test functions are compatible with diflFerent levels of vital 
accomplishment. 

71. Attention is invited to records of the following six 
subjects : 

Series C Series K 



Per cent surpassed by. 







Points 




Points 


Subject 


Total 


per 


Total 


per 




points 


minute 


points 


minute 


I 


6 


11 


10 


63 


II 


9 


28 


59 


85 


HI 


. 18 


54 


97 


99 


IV 


56 


87 


41 


75 


V 


85 


96 


52 


96 


VI 


93 




100 





72. Subjects I-III are experienced clerks working in the 
same office. To their employer they rank in business per- 
formance in the order represented by their test results, but 
these do not directly express the differences between them. 
This is partly because the comparative material is generally 
selected from the same level, of intelligence in which these 
subjects fall. This " dilates " the percentile differences. If 
the standard file had contained material from all levels of 
intelligence instead of from a rather high level only, these 
percentile scores would be higher and closer together. 

Subject IV is an ambitious young man of foreign birth, 
an office assistant, who has some language difficulty. Subject 
V is a college and medical graduate; Subject VI a Phi Beta 
Kappa college graduate, of further academic experience. 

73. These cases make relatively higher scores in points per 
minute than in total points earned. This betokens more 
hurried work. The examinations in these cases were in- 
dividual, tending probably to greater haste through greater 
self-consciousness. It is to be supposed that the attitude of 
the students was influenced by the analogous situation in 
academic examinations and quizzes, which are less acutely 
hurried than psychological tests. Money prizes were offered 
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for the best performance in the college and high school groups, 
but not in the other cases. 

74. Five of the more successful type of insurance salesmen, 
together with an office manager, were given the tests by their 
chief executive. The percentile scores are as follows : 



Sbribs C 


Sbribs K 


Sbribs R 




PdinU 




Points 




Points 


'otal 


per 


Total 


per 


Total 


per 


oinU 


minute 


poinU 


nunute 


poinU 


minute 


50 


12 


98 


41 


38 


32 


5 


4 


46 


53 


5 


3 


27 


7 


28 


12 


68 


82 


31 


26 


44 


11 


8 


H 


59 


55 


83 


52 


100 


96 


75 


94 


86 


83 


84 


80 



Per cent surpassed by VII 

VIII 

IX 

X 

XI 

XII 

75. Comment of the executive making the tests, based upon 
the points per minute score, is in part as follows : 

" If we eliminate XII, who is an office man, we find XI 
standing high in each of the different tests. This is in accord 
with what I believe to be the relation of XFs ability to the 
other men. In fact, I should grade them about as follows, 
from the standpoint of salesmanship and general usefulness 
to the Company in that particular: XI, VII, VIII, IX.^ 

"The difference between the five men would not be very 
great, although XI, perhaps, stands out somewhat more con- 
spicuously from the group than any of the others . . . 

"On the whole, it would appear that the R tests come 
nearer to matching up with our judgment of the men than 
either of the other two. Even here, however, IX takes second 
position, but that, after all, may be nearer right than my judg- 
ment. Five years ago, I would have placed IX at the head of 
the entire group, but during the last five years the character 
of his work has changed very considerably. 

" But even in the R tests, the differences seem to me to 
be very much greater than actually exist. It could not be said, 
for example, that XI is anything like so many times as good 
a man as VIII ® when it comes to the question of his value 
to the Company. 

" The C tests work out quite well as a measure of care- 
fulness. XII, the office man, stands at the head of the list, 
while the other men grade downward exactly in accord with 
what I believe to be the fact . . . while the R tests, if 

^A previous rating by the same individual is XI, VII, VIII, X, IX. 
A rating based on 1918 new insurance produced is VII, X, XI, VIII; 
IX's position cannot be clearly stated, but seems much improved. This 
has comparatively little correspondence with the test findings, (1917). 

« Cf. par. 72. 
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looked upon as a measure of resourcefulness, seem to be quite 
accurate with the exception of VIII, who in that quality 
should, I believe, rank ahead of X and perhaps ahead of 
VII." 

76. Only partial explanation is offered of the large differ- 
ences in performance between relatively equal levels of nonex- 
perimental competence. Responses in the tests depend on what 
is at the surface of the conscious, or can be brought there 
with such effort as the subject will apply thereto. Intelligence 
is more closely related to the content of the conscious than to 
emotional or motor processes; yet there are possible many 
differences in the content of the conscious among persons of 
similar degrees of intelligence. Military psychology has shown 
this on a large scale, for the content of the conscious as in- 
fluenced by occupation. Occupational differences can be but 
little invoked in the present instances. Other determinants, 
affecting consciousness and personality independently of in- 
telligence, are to be sought in temperament, general interests, 
attitude toward the tests. These appeared especially im- 
portant with Subject I who is much nearer II and III in pro- 
fessional usefulness than the test performance indicates. 

77, Intelligence is a factor in most civilized operations, and 
is quicker and surer reached in formal tests than otherwise. 
" Other things being equal " the more intelligent will always 
do better mental work ; and as other things are equal in chance, 
formal tests are at all levels better than no tests at all. They 
are most effective where the desideratum is a more or less 
routine efficiency of definite mental associations, as in clerical 
work. They are less effective for operations that deal with 
things rather than with ideas, and still less effective at the 
more executive levels of endeavor where less depends on 
intelligence in proportion to such qualities as cooperativeness, 
persistence, initiative, tact. " Other things being equal " they 
will still pick the more useful individuals ; but other things are 
more likely to be unequal, and their inequalities more im- 
portant, than at routine levels of mental work. 

F. L. Wblls. 
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Sherwin Cody. Commercial Tests and How to Use Them. World 
Book Company, Yonkers-on-Hudson, N. Y., 1919, p. 216. 
This book presents the history and technique of tiie National Ability 
Tests, which were used as the basis for the Efficiency Employment 
Register of high school graduates now being offered by the United 
States Employment Service in New York City. These Tests are in- 
tended for prospective office boys, general clerks, sales people, 
stenographers and bookkeepers. They are arranged in two parallel 
series of equal difficulty, each series containing 19 tests on such topics 
as: tabulation, invoicing, fundamental arithmetic, business arithmetic, 
writing and answering letters, stenography, copying on tjrpewriter and 
on mmeograph, addressing and filing envelopes, memory, English 
grammar, punctuation and spelling. Minute directions for administer- 
ing the tests, scoring and computing the data and sample records from 
several school systems are given. The book should prove very helpful 
to those interested in educational and vocational guidance. 

Arthur S. Otis. Manual of Directions for Administering the Otis 

Group Intelligence Scale, A Point Scale, Edition 1919, Forms 

A and B. World Book Company, Yonkers-on-Hudson, N. Y., 

1919, p. 37. 

This little pamphlet gives detailed directions for administering the 

Otis group tests, the underlying principle of which was incorporated 

in the United States Army tests. The complete material for giving the 

tests consists of (i) Examination Booklets, Form A and Form B; 

(2) Individual Record Card, for recording all available information 

about the subject tested; (3) Log Slip; (4) Examiner's Manual; 

and (5) Examiner's Key. The Booklets contain ten tests each of 

parallel difficulty, each test being suitable to subjects from the fourth 

grade up through the university. The tests include the following 

items: (i) following directions, (2) opposites, (3) disarranged 

sentences, (4) proverbs, (5) arithmetic, (6) geometric figures, (7) 

analogies, (8) similarities, (9) narrative completion, and (10) memory. 

Each test is arranged so that its successive elements become more and 

more difficult, and the score is based simply upon the total number 

of elements correctly answered. 

WiLUAM D. Lewis and Edgar A. Singer. The Winston Simplified 

Dictionary, Including all the Words in Common Use, Defined so 

that they can be easily Understood. (Illustrated.) The John C. 

Winston Company, Philadelphia and Chicago, 1919, pp. xxii+820. 

The vocabulary included in this book has been chosen with special 

reference to educational needs and the definitions are given in plain, 

simple language, avoiding the frequent dictionary error of repeating 

in the definition the word to be defined. One or two random samples 

will suffice to indicate the character of the work: 

Calculate (kUllculat), v. t, to add, subtract, multiply, or divide any 
sum to find the result; to determine by any process of reasoning; to 
estimate, as, no one can calculate the benefits of electricity to the 
world : v, i. to make a computation ; to rely, with or or upon. 

194 
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Solm-on (sitn'iin), n. a sea fish, found in northern waters, which 
ascends rivers to lay its eggs ; the yellowish-pink color of salmon flesh ; 
adj, of the yellowish-pink color of salmon flesh. 

The Introductory Part contains an eight-page discussion of the 
topic " How Our Language Has Grown," ten rules for spelling deriva- 
tive words, explanatory notes on varied spelling, capitals, hyphens, etc., 
a short list of abbreviations used, and a guide to pronunciation. It 
is greatly to be hoped that this new book will supplant the cumbersome 
school dictionaries now in use, at least in the elementary grades, and 
we recommend it not only for every classroom, but for every home 
as well. 

The General Education Board has just published a series of eight 

reports on various aspects of the Gary Public Schools, including the 

following : 

Abraham Flexner and Frank P. Bach man. The Gary Schools: 
A General Account, p. 265. 

George D. Straver and Frank P. Bach man. Organisation and Admin- 
istration, p. 126, with 7 School Programs. 

Frank P. Bach man and Ralph Bowman. Costs, School Year iqjs- 
iqj6, p. 86, with 9 Tables and 22 Schedules for Expenditures. 

Charles R. Richards, Industrial Work, p. 204. 

Eva W. White. Household Arts, p. 49. 

Lee F. Hanmer. Physical Training and Play, p. 35. 

Otis W. Caldwell. Science Teaching, p. 125. 

Stuart A. Courtis. Measurement of Classroom Products. 



The Colorado State Teachers College Bulletin of October, 1918, con- 
sists of "A Study in Spelling," by Professor J. D. Heilman. The 
Bulletin of March, 1919, contains "A Study of the Mechanics of 
Reading," by the same author. 



The Committee on Classification of Personnel in the Army has 
issued "A Summary of the Work of the Classification Division of 
the Adjutant General's Department" which contains brief descrip- 
tions of the following items : The Task of Army Personnel Organiza- 
tion, The Classification of Soldiers, Soldiers' Classification Card, Trade 
Specifications and Occupational Index, Trade Tests, Tables of Occupa- 
tional Needs, Personnel Specifications, Classification and Rating of 
Officers, The Rating Scale, The Rating Scale Card, Relations with the 
Field, and The Recruit Receiving Building. 



In a recent Bulletin of the University of Wyoming Professor June E. 
Downey contributes a study entitled "The Will-Profile, A Tentative 
Scale for Measurement of the Volitional Pattern." The profile is 
based upon a quantitative measurement of the following ten factors: 
coordination of impulses, accuracy, tenacity, resistance, assurance, 
motor-impulsion, speed of decision, flexibility, freedom from inertia, 
and speed of movement. Most of the items are determined by an 
examination of handwriting under various conditions; as: normal, 
speeded, retarded, disguised, imitated, blocked, with eyes closed, with 
distractions by counting by 2*s or by 3*s, etc. Each of the ten tests is 
scored on a basis of ten points, and the will-profile for each individual 
is constructed on the scores obtained in the ten factors. 
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The Bureau of Educational Experiments in New York City has 
secured the services of Dr. William R. P. Emerson, under whose 
direction a series of experiments with " nutrition classes '* have been 
carried out. Some of the results and conclusions of this work are 
presented by David Mitchell in an article on " Malnutrition and Health 
Education" in the recent March issue of the Pedagogical Seminary. 
This paper contains a number of valuable tables on the distribution of 
children according to percentage of over and underweight in grades 
I, V, VI, VII, in a special class for exceptionally bright children, 
and in an open air class. After an initial measurement in height and 
weight these classes were subjected to several kinds of treatment; for 
instance, the 7th grade received instruction in health habits, physical 
care in the removal of defects interfering with nutrition, a half-hour 
rest period during the forenoon, and a mid-day lunch. The other 
classes received similar combinations. At the end of 19 weeks the 
children were remeasured to observe the changes produced by the 
various methods of treatment. Among the causes for lack of gain or 
loss in weight the following were prominent: enlarged tonsils and 
adenoids and carious teeth. Some of the important conclusions drawn 
by the author are: that provision of food in school is in itself not 
adequate to solve the problem of malnutrition, that stimulants, such 
as tea and coffee, should be eliminated, that physical defects should 
be removed, and that the children should be taught in hygiene and 
health habits. 

The Thirteenth Biennial Report of the Board of Trustees of the 
Preston School of Industry, lone, California, covering the time from 
July 1st, 1 916 to June 30, 191 8, contains an enquiry into the mental 
conditions, character and antecedents of 300 boys who were in the 
school on June ist, 1918. The psychological data were collected by 
Fred. H. Allen and Warner Brown and were based upon a mental 
examination with the Goddard revision of the Binet scale and other 
supplementary tests, and upon a critical behavioristic study made dur- 
ing the first few weeks of the boy's stay at the school. On the basis 
of tiiis study it was found that about one third of the 300 boys were 
dull normal or above, one third borderline cases, and the remaining 
third were definitely defective. Of the latter group, 27 cases showed 
symptoms of slight psychopathic instability and 6 cases presented con- 
spicuous symptoms of mental abnormality. 



The National Association of Employment Managers began last 
January the publication of a monthly bulletin, called ** Personnel/' 
The second issue contains a succinct description of trade tests. Three 
columns in each issue are devoted to recent publications in related 
fields. We welcome this new publication and trust that it will con- 
tribute materially to a widespread recognition of the human factor and 
the psychological problems involved in the relations between employer 
and employee. 



The University of Illinois has established a Bureau of Educational 
Research under the directorship of Professor B. R. Buckingham. 
Among the aims of this Bureau are : the compilation of bibliographies 
on educational topics; assisting school authorities in devising records 
for general and specific purposes; the study of such problems as the 
grouping of grades, the function of special classes, continuation and 
part-time schools, school statistics, and school accounting; giving aid 
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in selecting, retaining, supervising the teaching force; and the admin- 
istration and computation of educational tests in cooperation with 
local school authorities. 

The scope of the Bureau of Salesmanship Research at the Carnegie 
Institute of Technology, Pittsburgh, has recently been enlarged to 
include factory and clerical workers and executives, as well as sales- 
men. The organization is now known as the Bureau of Personnel. 
Its purpose is to study methods of selection, training, development, 
supervision, and compensation of employees. 



The Public School System of Santa Ana, California, has established 
a Department of Research, with Mary Bess Henry as Director. The 
first Bulletin published by this new Department contains a discussion 
of " Mental Testing as an Aid in Guidance and Classification of School 
Children." The results reported are based on Otis' vocabulary tests, 
Otis* group tests of intelligence, teachers* estimates of intelligence, and 
scholastic records. 

Professor L. L. Thurstone of the Division of Personnel and Psy- 
chology at Carnegie Institute of Technology, Pittsburgh, has recently 
issued two booklets for the psychological examination of college fresh- 
men and high school seniors, Part A and Part B, and also a " Test of 
Engineering Aptitude for College Freshmen and High School Seniors." 
The former consists of one hundred short problems with directions 
for each. The subject is asked to solve as many as he can in twenty 
minutes. The engineering test contains 24 mechanical problems with 
directions, the subject having 30 minutes for solving as many as he 
can do. 

Dr. Walter B. Swift, has just returned to Boston from Cleveland, 
where he has spent about a year installing and supervising Speech 
Correction in the Qeveland Public Schools. He trained up 15 teachers 
who are part time speech teachers. They do their regular grade work 
as usual. The part time speech teacher is one of the unique features 
of the Swift methods and systems of speech correction. In Qeveland 
there are now 46 classes and over 600 cases under treatment. Dr. 
Swift will be in Milwaukee, Wis., in July and Athens, Ohio in August. 
He is booked to give informal courses in these two cities this summer. 



The National Society for the Study and Correction of Speech Dis- 
order will have its summer meeting in Milwaukee, on July 4, as one 
of the affiliated Societies of the National Educational Association. 
Members of the Society and invited guests of prominence in the field 
of speech correction, will address the Association. Anyone interested 
to receive an advanced program may do so by addressing the Secretary, 
Miss Marguerite Franklin, no Bay State Rd., Boston Mass. 



The following publications have been received : * 
James Burt Miner. Deficiency and Delinquency, An Interpretation 

of Mental Testing. Educational Psychology Monographs, No. 21. 

Warwick and York, Baltimore, 1918, p. 355. 
Roy Frankun Richardson. The Psychology and Pedagogy of Anger, 

Educational Psychology Monographs, No. 19. Warwick and York, 

Baltimore, 1918, p. 100. 

1 Mention here does not preclude further comment. 
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The Journal of Educationctl Psychology, Vol. x, No. 2, February 1919. 

Published by Warwick and York, Baltimore. 
University of Oregon Bulletin, New Series, Vol. xv, No. 12, The 

University High School, issued by Department of Education. 

September 1918. Published by University Press, Eugene, Oregon. 
Children's Year Leaflet No. 10. Advising Children in their Choice of 

Occupation and Supervising the Working Child. U. S. Department 

of Labor, Children's Bureau. Bureau Publication No. 53. Pub- 
lished by Government Printing Office, Washington, 1919. 
Carry On, A Magazine on the Reconstruction of Disabled Soldiers and 

Sailors, Edited by the Office of the Surgeon General, U. S. Army. 

Published by the American Red Cross. Vol. i, Nos. 7 and 8, April 

1919 and May 1919. 
The Porto Rico School Retnew. San Juan, Porto Rico. Vol. 3, Nos. 

6 and 9, February and May 191 9. 
Revista de Psiquiatria y Disciplines Conexas. Vol. i. No. 3, January 

1 919. Published at Gremios 435, Altos-Lima, Peru. 
Revista de Educacion. Tercera Epoca. Vol. i. No. 2, March 30, 1919. 

Published by the Servicio Nacional de Instruccion Publica. Santo 

Domingo, Republica Dominicana. 
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Vol. Ill SEPTEMBER, 1919 No. 3 

A NON-LANGUAGE GROUP INTELLIGENCE TEST 



By Rudolf Pintner, Ohio State University 



The usefulness of group tests for the measurement of in- 
telligence is resulting in the appearance of a. great number of 
such tests, and the development of this type of test marks the 
most important advance in mental testing during the past few 
years. The best known group tests at the present^time depend 
largely, if not entirely, upon the knowledge and use of lan- 
guage. They presuppose the ability to read and wtite the 
English language. Apart from the debatable question as to 
whether ability to use and handle words is the best measure 
of general intelligence or as to whether it alone should be 
used as such a measure, it is very desirable to have tests which 
do not involve any language. In our industries and schools 
there are many foreigners whose knowledge of English is en- 
tirely lacking or so meagre as to be useless for testing pur- 
poses ; and in addition we have a great many illiterates. The 
Army Beta Test and the recently published Thomdike^ Group 
Test without Language are the only tests adapted for sucn 
subjects known to the writer at the present time. 

For the past two years the writer has been wt)rking with a 
set of tests that involve no language, that can be given to 
illiterates, that do not demand a fctiowledge of English in 
order to understand the directions for doing the tests. In 
this way the illiterate, the foreigner and the deaf will all be 
given an equal chance with the hearing English-speaking liter- 
ate individual. 

^ Thomdike, E. L. A Standardized Group Examination of Intelli- 

fence Independent of Language. Journal of Applied Psychology, Vol. 
II, No. I, March 1919. pp. 15-32. 
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Test No. I. — The Imitation Test* 

This is essentially the same as the Knox Cube Test using 
dots on a blackboard and a pointer to make the moves. The 
subjects draw lines from one dot to another showing the se- 
quence and direction of the moves. The twelve lines in the 
test series were chosen out of a trial series of twenty-five and 
they progress gradually from easy to hard. The tw'enty-five 
lines of ttie trial series were chosen in such a manner that the 
drawing of the lines from one dot to another would be easily 
distinguishable on paper. In some combinations of move- 
ments from one dot to another lines coincide, and it would 
be impossible, when correcting the paper, to tell whether the 
' subject had been working correctly or not. The trial series 
of 25 lines was given to 245 university students and also to 
56 school children in the fourth and sixth grades. The fol- 
lowing is the trial series of twenty-five lines, together with 
the percentages of correct responses for the children and the 
adults. 
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. 62 


13 


124314 


45 


14 


1342 12 


54 


14 


14 2312 


. 50 


7 


14 3 2 12 


78 


23 


1234 2 1 


. 80 


50 


12343 1 


. 90 


.... 46.5 


124321 


77 


43 


1234 14 


91 


59 



The correlation between the rank order of the lines for the 
adults and children is .87. This correlation is very high and, 
therefore, it is somewhat immaterial which order we take. 
The greatest discrepancies in the difficul^ of the lines occur 
in line 16 where we have a difference of 9.5 rank places, in 
line 21 where we have a difference of 5.5 places and in lines 
6, 23, 1 and 4 where we have a difference of 5 places. 

From these twenty-five lines we have chosen twelve which 
gradually increase in difficulty, basing this largely upon the 
adult order of difficulty but taking into account the order of 
difficulty obtained from the children's records. The final 
series of lines chosen is gfiven under the directions for giving 
the tests. 

Test No, 2 — The Easy Learning Test 

This test is simply a very easy substitution test of the type 
common in psychological tests. The idea was to niake a very 
simple substitution test which very young children could man- 
age. For this reason only three digits were used and three very 
easy symbols. The squares are large enough so that small 
children can write in digits, and the sample digits filled in at 
the beginning of the test gfive the child an idea of what he is 
supposed to do. 
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Test No. 3.— The Hard Learning Test. 

This is essentially the same as the previous test and in fact 
the Easy Learning Test serves as a method of teaching what 
is required in the Hard Learning Test. In the Hard Learn- 
ing Test the child performs the same operation as in the easy 
test, the wily diflference being that here he has to work with 
nine digits and symbols instead of with three. The digits 
and S3anbols are those used in the standard S)anbol-Digit Test. 

Test No. 4. — The Drawing Completion Test. 

This is a shortened form of the large Drawing Completion 
Test devised by Pintner and standardized by Pintner and 
Toops.* The series of pictures is arranged in order of diffi- 
culty from very easy to relatively hard. 

Test No. 5. — The Reversed Drawing Test. 

This test was suggested by Mr. H. A. Toops. We made a 
preliminary experiment with a large number of drawings 
and tried these out on a great many observers before choosing 
the ten for the final series. The final series was again arrived 
at by choosing drawings that progress in difficulty from easy 
to hard. In each case the figure to be completed is started 
by two lines so that whether the reversal is up-down or right- 
left the observer must himself decide by finishing the picture 
from the two lines that are gfiven. It is obviously a type of 
spatial relations test. 

Test No. 6.— The Picture Reconstruction Test. 

This test was devised by the writer, the idea being to give 
as a gfroup test the common operation of putting blocks to- 
gether that will form a complete picture. It is essentially 
the same as the child's game of putting pieces together to form 
a picture. However, when we transfer this to paper and do 
not allow the manipulation of the parts of the picture, it be- 
comes very much more difficult. It means that we have to 
reconstruct more or less in our minds the complete picture. 
Several pictures were arranjjed and mimeographed copies of 
these .were made from which six were chosen. These six 
progress from very simple to very hard pictures. 

The whole series of six tests are made up in booklet form 
allowing one page for each test and the first cover page for 
name, age, school, etc. 

* Pintner, R. and Toops, H. A. A Drawing G>mpletion Test Journal 
of Applied Psychology, Vol. II, No. 2, June 1918. pp.164-173. 
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Titne Limits. 

After the final series for each test was decided upon, it 
was necessary to fix upon a time limit for each test. For 
this purpose the tests were tried out on adults and children 
in order to get some idea of adequate time limits. As a gen- 
eral rule a time limit for any test should be such that none, 
or at least very few, should be able to finish within the time 
limit. Since these tests are to be given to all ages from six 
or seven upwards it is, of course, impossible to adhere to this 
standard rigidly, because, if we did so, we should have to fix 
the time limit in accordance with what the quickest adult 
could perform. In many cases this would mean that the 
seven-year-old child would hardly have time to begin the test 
before the time limit would have elapsed. We must, there- 
fore, adjust our Umit rather to the medium aged child. 

Furthermore, we can draw a distinction between some tests 
where the time is very essential and others where rapidity of 
work is not so essential. Rapidity of work is the greatest 
factor in tests two and three, but is not nearly so important 
in the other tests. 

A group of children were tested and the time for the first 
who finished was taken. This gives us the following times: 

Test 2 — 47 sec. 

Test 3 — 73 sec. 

Test 4 — 1 min. 

Test 5 — 2.5 mins. 

Test 6 — 5 mins. (but not correct). 

For Test 2 it took 1 minute 20 seconds for about half the 
class to finish, for Test 3, 1 minute 45 seconds for half the 
class, and Test 4, 1 minute 45 seconds. In Tests 5 and 6 the 
children were stopped after 6 minutes because practically 
none of them had finished and these are tests over which 
children may ponder for a long time. 

Using this data and other results from adult observers as 
a basis the time limits, as given below under the directions for 
giving the tests, were decided upon, making a total of 13.5 
minutes in addition to the time required for giving Test 1. 

With reference to these time limits we may note that one 
minute for Test 2 is rather too long for older children, but 
since this test is an important one for younger children it is 
necessary to give them adequate time to get under way. It 
takes an adult working rapidly about 37 seconds to finish, 
but only 50 to 60% of University students finish within one 
minute. For Test 3, 1J4 minutes will permit very few chil- 
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dren to finish. In Test 4, 2 minutes as a rule is ample, and 
this length of time is allowed because rapidity of work is not 
the essential factor in this test. The time limits of 4 and 5 
minutes for Tests 5 and 6 respectively are very liberal for 
the older children and this has been purposely so arranged, 
because in these two tests quality of work rather than speed 
is the essential factor. With the younger children these time 
limits have been found to be fully adequate for all that they 
are able to accomplish. 

Directions for Giving the Tests, 

Pass papers — have subjects put full name, age last birthday 
and grade on first page and tell them not to turn page until 
told to do so. 

Test I, — Imitation, 

No time limit. Draw on blackboard one row of four large 
dots and also to one side of the board three rows of smaller 
dots in rows as on sheet. Move the pointer from dot to dot 
in order 12 3 4 and, using the first series of smaller dots, 
draw lines to show subject what he is to do, thus .^.^.^-n. 
Follow with samples 12 3 4 2 .^.^.^., 14 2 3 1 

C ''c^:> 1^ • There is no need to do any talking if the 
children are foreign or deaf. After giving the samples have 
the subjects take their pencils. Erase the three samples on the 
board. 

Give the following series in order with sufficient intervals 
for the subjects to draw the connecting lines. 

1 12341 7 13241 

2 1432 8 123421 

3.; 14 23 9 13 242 

4 14321 10 12431 

5 123431 11 134212 

6 1342 12 124314 

Before beginning each row be sure to have the attention 
of the group and at the end give some signal to them to draw 
the line on their paper. Move the pointer from one dot to 
the other without raising it from the blackboard at the rate 
of about one a second pausing somewhat on each dot. 

Test 2, — Easy Learning, Time limit 1 minute. 

Hold sheet up before the class and point to the key at the 
top, first at the symbol, then to the numbers, explaining that 
they must copy in the numbers. Also show the children that 
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the first few squares have been filled in and indicate that they 
are to complete the sheet. 
With young children draw a sample on the board. 

Test J. — Hard Learning. Time limit lj4 minutes. 

Proceed as in Test 2. 

Test 4, — Drawing Completion. Time limit 2 minutes. 

Draw a head without one eye on the board. Ask what is 
missing. Draw in the eye. Hold the test blank up before 
the class and pretend to draw the eye, and indicate they are 
also to complete the other drawings. 

Test 5. — Reversed Drawings. Time limit 4 minutes. 

Draw on the board the two following samples, accentuating 

the heavy and fine lines : ^\ \/^ 



^ 



Trace with the finger the heavy lines on the first figure and 
then the similar lines on the second figure. Cover the first 
figure with the opened left hand palm towards the board, turn 
the hand slowly over, at the same time bringing it to cover the 
second figure, showing by the motion that the figure has been 
reversed. Repeat this movement once or twice. Now trace 
the fine line on the first figure with the finger and show where 
it should go on the second figure. Then draw in the fine line 
and repeat once again the turning-over movement of the hand. 
In the same way demonstrate the third and fourth figures 
composing the second sample. If the children are hearing 
English-speaking appropriate language should accompany the 
demonstration, without however adding to the instructions. 

Test 6. — Picture Reconstruction. Time limit 5 minutes. 

For this test a sample picture cut in half and mounted on 
cardboard with the numbers 2 and 1 on the two halves of the 
picture must be prepared. The writer uses a drawing of a 
little girl traced in India ink on two pieces of white cardboard 
each measuring about 6 x 17 inches. The number 2 must be 
at the bottom of the left half of the picture (facing the pic- 
ture) and the number I on the right half. Place the two 
pieces in order 1 2 on the rail of the blackboard, i. e., the two 
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parts of the picture will not be in the right order. On the 
board draw a square divided into two parts for the numbers 
as on the test blank. Trace with finger the outline of the first 
part of the picture and indicate into which space it would go 
on the board and similarly with the second part of the picture. 
Then point to number 2 and write it in the first space on the 
board and then to number 1 and write it in the other. Point- 
ing to the numbers and spaces may be repeated more than 
once. Having written in the numbers now hold the two parts 
of the picture over the space on the board so as to make a 
complete picture and indicate the complete picture. Then 
show that the numbers in the spaces on the board correspond 
with the numbers at the bottom of the two parts of the picture 
which is now being held just above them. This demonstra- 
tion is generally sufficient to prepare the children for the test, 
beginning as it does with a very simple example almost the 
same as the sample used in the demonstration. 

Scoring the Tests, 

Celluloid stencils are used in scoring Tests 1, 2, 3, 5 and 6, 
thus simplifying the work and making it very rapid. A 
stencil does not help in scoring Test 4 (Drawing Completion). 
The following crude scores are given: 
Test 1 — One point for each line absolutely correct. Total, 

12 points. 
Test 2 — One point for each space filled in with the correct 

digit. Total, SO pomts. 
Test 3 — One point for each space filled in with the correct 

digit. Total, SO points. 
Test 4 — Two points for the rig^t thing in the right place; 

one point for the right thing but not rightly placed. 

Total, 20 points. 
Test 5 — One point for each reversed drawing correctly per- 
formed. Total, 10 points. 
Test 6— One point for each number in the proper space. 

Total, 31 points. 
Having scored the test these crude scores are recorded on 
a record card and weighted as follows: 

Maxifnum Maximum 

Test Crude Score Weight Wei^ted Score 

1 12 9^ 108 

2 50 2 100 

3 50 2 100 

4 20 5 100 

5 10 10 100 

6 31 3 93 

Total 601 
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Correlations. 

The following correlations have been obtained between each 
test and the total score on the whole series of tests : 

Test 

n. 1. 2. 3. 4. 5. 6. 

127 78 83 84 76 67 65 

12 110 67 78 80 50 50 56 

University Students 74 36 44 45 41 66 65 

Tests 2 and 3 give the highest correlations for the children, 
while Tests 5 and 6 give the highest correlations for the adults. 

Standards. 

Tentative standard scores based upon results with ordinary 
grade children according to age are shown in Table I, which 
gives the number of cases tested at each age, the median and 
the 80 and 20 percentiles. It will be seen that the median 

Table I. Distribution of Scores by Ages 

Age 7 8 9 10 11 12 13 Univ. 

Students 

No 72 97 143 195 175 127 111 72 

80 Percentile 123 231 301 338 352 357 382 549 

Median 76 130 190 272 285 290 309 501 

20 Percentile 38 72 111 170 202 202 209 419 

score rises steadily at each age, and the same is true -of the 
80 and 20 percentile scores. 

Table II gives a percentage distribution of the cases ar- 
ranged according to age and to score, showing a steady in- 

Table II. Percentage Distribution According to Age and Score 

Age 
Score 7 8 9 10 11 12 13 14 Univ. 

Students 
0-99.... 67 33 18 12 4 2 5 .. 
100-199.... 28 37 34 13 15 16 14 16 
200-299... . 5252638 37 342733 

300-399 5 21 32 36 40 42 38 15 

400—499 1 5 6 7 12 13 34 

500-601 2 1 51 

crease in score from age to age and a fairly wide distribution 
of abilities at each age, such as we would expect among un- 
selected school children. 

Figure I shows a percentage distribution curve for ages 7, 
9, 11, 13 and University Students. We note how the curves 
shift over from the left to the right with the advance in age. 
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None of the seven-year-olds make scores above 299 and none 
of the University students make scores below 300. Although 
the modes of the curves at each age are distinct and increase 
in score, there is considerable overlapping in abilities at each 
age as there should be. 
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The results given here can only be regarded as tentative 
standards. A much larger number of cases should be tested 
in order to arrive at accurate percentile norms. 

So far only 16 cases have been tested on the Stanford 
Binet and this group test. The correlation between the I. Q. 
on the Stanford and the percentile rank on these tests is .to. 
There is obviously a fairly close agreement between the two 
ratings. 

With regard to the scores of the University students it will 
be noted that about half of them score over 500 points out of 
a possible 601, but that there also is a fair scattering of cases 
down to scores of 300. None obtained the maximum score, 
so that it would seem that the test is capable of giving some 
kind of a differentiation among people of high intelligence. 
A group of nine university instructors were also given the 
test. The median score of this group is 573, as contrasted 
with the median of 501 for university students. Indeed all, 
except one, of the instructors made a score higher than the 
median of the students. It would seem, therefore, that the 
test might show some differentiation of ability among those 
making high scores. 

Summary. 

1. A set of six non-language tests has been arranged for 
group testing purposes, suitable for school children and for 
adults. 

2. The tests can be given alike to English-speaking and 
non-English-speaking subjects, to literates and illiterates, to 
deaf and to hearing. 

3. A method of procedure in giving the tests has been 
worked out. The time required for explaining and giving the 
tests is about thirty minutes. 

4. Correlations between each test and the total score are 
all positive and fairly high. 

5. Tentative norms have been arrived at for children of 
ages 7 to 13 inclusive, and for University students. 

6. The tests should prove useful in mental survey work 
particularly in communities where there is a large foreign or 
illiterate element. 
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A GROUP INTELLIGENCE SCALE FOR PRIMARY 

GRADES 



By Frances Lowell, University of Minnesota 



Introduction 

In October, 1917, the writer began a survey of all the schools 
in one of the representative counties in Minnesota, for the 
purpose of locating all cases of subnormality.* Such a survey 
necessitates, among other things, visiting every school in the 
county, selecting sll children of questionable mentality, and 
testing them, individually, with the Binet-Simon tests. 

The selection of retarded and subnormal children above the 
third grade is relatively easy, for teachers' estimates, previous 
school records, and repetition of grades without the excuse of 
a long continued absence taken together form a fairly accurate 
basis. However, such methods are practically impossible in 
and below the third grade. This is due to several factors: 
first, to the inaccuracy of the school records for primary 
grades ; second, to the frequent change of teachers, especially 
in the rural schools ; third, to the fact that many children have 
been in school too short a time to become sufficiently retarded 
pedagogically to suggest a diagnosis of mental deficiency ; and 
fourth, to the inability of many children, on entering school, 
to do themselves justice in the grade because of the strange- 
ness of the new environment. Other difficulties, common to 
all grades, are also encountered in such a survey. Teachers 
frequently persuade themselves that since a child is sweet, 
docile and attractive, he must necessarily be bright; or, be- 
cause he is doing good work in his £^rade, he is undoubtedly 
normal, regardless of the fact that he is two or three years 
older than his classmates. In one rural school, the teacher, 
on being asked about the work of twin girls in the third grade, 
said with great assurance, " Oh, those girls are very bright 
They do good third grade work, and they are such nice chil- 
dren." 'file twins in question had a chronological age of 
twelve years, a fact entirely overlooked by the teacher in her 
estimation of their ability. Mentally, they were found to be 

^ This survey was made tinder the direction of Dr. Fred Kuhlmann, 
Director of Research, Faribault, Minnesota. 
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7^ and 8J^ years, respectively, when given the Binet tests. 
Hence, in order to have an accurate survey, the need for an 
impersonal method of selecting children of doubtful mentality 
was imperative. 

History of Group Tests 

At the time the survey was undertaken, no group scales of 
intelligence had been published. Many single group tests had 
been standardized and published, but these, alone, are insuffi- 
cient for making even a rough classification of children. How- 
ever, within the past year, two scales have appeared, namely, 
one g^ven in the "Mental Survey"* and "A Group Point 
Scale."' The g^up tests used in army woric are not dis- 
cussed here because they are intended for adults only, and, 
too, because they have not been published. 

Pintner, in his " Mental Survey," recognizes the need for 
standardized survey tests for selecting individuals for further 
examination and for special promotions in the schools. To 
provide such a scale, he uses well known tests, namely: 

1) Rote memory 

2) Digit-symbol 

3) Symbol-digit 

4) Word-building 

5) Opposites 

6) Cancellation. 

Norms, in terms of percentiles for each chronological age 
from six to sixteen inclusive, are given for each of the six 
tests. Each individual's record of actual attainment is taken 
for each test, and later translated into its corresponding per- 
centile. The* index of a child's mentality is found by getting 
the median of the six percentiles. 

The reliability of the survey scale is checked by correlating 
results with those found by using the Yerkes Point Scale. 
In the sixth grade a correlation of only .29 was found ; in the 
fourth g^de a correlation of .59 existed, and in the second 
grade, one of .71. When compared with results from Binet 
tests, the correlation was found to be .66. These results tend 
to show, according to Pintner, "that we must not place too 
much reliability on the survey tests for individual purposes, 
but that for groups they give a fairly accurate measure of 
mentality." 

« R. Pintner : The Mental Survey. 1918. 

» S. L. Prcsscy and L. W. Prcssey : A Group Point Scale. Journal 
of Applied Psychology, September, 1918. 



Digitized by 



Google 



A GROUP INTELLIGENCE SCALE FOR PRIMARY GRADES 217 

The Presseys took charge of the mental testing done in 
connection with the survey of a certain county in Indiana, 
which the Departments of Psychology and Sociology of In- 
diana University started in the fall of 1917. They, too, felt 
the need for group tests where large niunbers of children were 
to be tested and so they tried to work out " a scale composed 
of tests which should be applicable over a wide range of ages 
— ^if possible from the second grade through high school — 
. and which should be highly differential of general intelligence 
throughout this range." 

The first requirement, in the selection of any test, is that 
its " beginning be easy enough and the directions clear enough 
so that nine-tenths of the 3B children would make some score, 
and that the end of the test should be hard enough so that 
no one of the high school scphomores (averaging sixteen 
years old) would make a perfect score." 

The second requirement for the tests, and the one which 
the Presseys consider the most original feature of their scale, 
is that of " careful adaptation in the nature of the tests, and 
in flexibility and ease in control of the class, for work with 
school children." 

The tests used are ; 

1) Rote memory 

2) Logical selection 

3) Arithmetic 

4) Opposites 

5) Logical memory 

6) Word completion 

7) Moral classification 

8) Dissected sentences 

9) Practical information 
10) Analogies. 

The results of these tests have been worked out in terms of 
percentiles, and norms published for about one thousand chil- 
dren. Then the reliability of the tests in sorting out extreme 
cases was checked up by comparing group records of twenty- 
one children found in the public schools — who, according to 
the Binet tests, had I. Q.'s of .76 or below — ^with records of 
normal children. It was found that the twenty-one cases 
" average at the 4 percentile of their age by the group tests ; 
the highest scores made by these cases were at the 8 percentile." 

The ability of the tests to sort out extreme cases was fur- 
ther noted in testing a group of " gifted " children with I. Q.'s 
above 1.25, and also a group of children from an institution 
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for feebleminded. The former group made scores averaging 
at the 98 percentile, whereas, in the latter group, only three 
were able to make a rating above the lowest 10 percentile of 
school children of the same ages. 

Again, the age-grade status of children was compared with 
their rating by the group scale, and " the 143 retards in the 
ages from ten through sixteen average 70 points lower on 
their group test score than the 124 accelerates of the same 
ages." 

The correlation of group test rank with teachers' rank, aver- 
ages .65. 

Finally, in order to show the reliability of the tests as a 
measure of general intelligence, comparisons have been made 
between results from three cities for one age and also for one 
grade. " The results obtained by the group tests by age show 
an average difference for the medians of less than two points, 
whereas the differences by grade average thirteen points." In 
other words, if a comparison of results from a single age 
group, as eight, is made for each of three cities, there will be 
an average difference for the medians of less than two points. 
However, if one compares the results from one £^rade, such 
as the third, for each of the three cities, the difference for the 
medians will average thirteen points. 

Although both the Pressey and Pintner scales seem to fur- 
nish a fairly reliable method for sorting and classifying large 
groups of children above the second grade, neither of them 
can be applied in the kindergarten or first grade, because chil- 
dren just entering school can neither read nor write, and both 
of these accomplishments are necessary to success in the Pint- 
ner and Pressey scales. Therefore, even had these tests been 
available in the fall of 1917, they would not have been entirely 
satisfactory for the purposes of the writer. 

Purposes of the Present Scale 
In devising and standardizing the present group tests, the 
writer had two purposes in mind : first, to secure a scale for 
measuring the intelligence of large groups of children accu- 
rately enough to sort out all children of questionable normal- 
ity. One could then be reasonably certain that these children, 
when tested individually by the Binet revisions, would be 
found mentally deficient, and the time ordinarily spent in 
testing cases wrongly estimated by teachers to be subnormal, 
would be saved. 

The second purpose was to obtain a group scale which 
would discriminate between dull, average and super-normal 
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children in kindergarten and primary grades. One finds here 
children who, regardless of their chronological age, are men- 
tally capable of attempting the school work of the next higher 
class. On the contrary, some children will succeed better if 
permitted to remain a second term in one grade, and receive 
special help in overcoming individual difficulties. Still others, 
though chronologically eligible, should be kept at home or in 
kindergarten, until their mental age justifies their entrance 
into the first grade. 

The importance of correctly selecting and placing the chil- 
dren of various degrees of mentality at the very outset of 
their school life, is realized when one considers that a dull 
child who attempts the same work as a normal child becomes 
so discouraged by his constant failures, and so overwhelmed 
by the hopelessness of the task, that it takes years to over- 
come the resulting lack of self-confidence, and to make him 
exert his best effort; whereas, the gifted child, for whom the 
work of the first grade is too easy, forms unfortunate habits 
of study, becomes uninterested and often troublesome. Mean- 
while, taxpayers bear an unnecessary burden when children 
have to repeat grades or are allowed to spend a whole year 
on work which might have been done in half the time. 

So with the object in view of supplying a possible solution 
for the problems involved in school promotions, as well as the 
more immediate purpose of securing a group scale for sorting 
out subnormal children for the survey, the present series of 
group tests to be used in primary grades was devised. 

Some of these group tests are adaptations of the original 
Binet-Simon tests; some have been taken from Dr. Kuhl- 
mann's 1917 Revision and others from Dr. Terman's Revision ; 
still others were suggested by tests standardized by the Bureau 
of Analysis and Investigation in New York ; and the rest are 
original. 

The Principles Involved in the Selection of Tests 
The requirements of the group test are many, for not only 
must it possess the characteristics necessary to the individual 
test, but it must also satisfy various other demands. Sim- 
plicity is an important criterion in the selection of the group 
test: simplicity of material, of directions, of response, and of 
scoring. 

Since a large number of children must be tested at one time, 
it is necessary that tests be selected in which the material used 
can be easily carried and quickly distributed. In order to 
facilitate handling, and to avoid confusion, the writer has ar- 
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ranged the material for the group tests in booklets. To each 
child, who has been in school less than one year, i. e., who is 
in the first grade, and hence can read and write but little, a 
booklet, 7y2 in. x 7j^ in., is given, which contains material 
and blanks necessary for the fifteen tests designated as five, 
six and seven year tests. Children in the second grade re- 
ceive similar booklets designed for six, seven and eight year 
tests; while third grade pupils get booklets for the seven, 
eight and nine year tests. Thus, all the responses of each 
child are kept together, and confusion incurred by distributing 
and collecting loose sheets of paper every few minutes is 
avoided. All pages of the booklet are munbered, and definite 
spaces are allotted to each test. All possible elimination of 
disturbing elements is important, for in the primary grades 
the attention of the children is easily distracted. 

Not only must the material for the tests be simple, but the 
directions to be followed must be clear and brief. Herein 
lies the greatest difficulty in selecting tests for a group. Fre- 
quently one feels confident that the directions for a certain 
test are perfectly clear and that they could not possibly be 
misunderstood, and yet when the test is given to a group of 
children, he finds that the meaning is entirely lost. Good 
English must frequently be sacrificed, for the child in the 
primary grades is surprisingly limited in vocabulary. Origi- 
nally, in giving the directions for one of the six year tests, the 
writer said, " Make a cross in the LARGEST square." The 
result was puzzling, for the children crossed the smallest 
square as often as they did the largest. The test j^parently 
was a failure for that age group. However, before discarding 
it, the writer decided to experiment a little to see if the diffi- 
culty could be discovered. Instead of having the children 
cross the square, they were asked to point to the largest square, 
whereupon one little g^rl tearfully informed the writer that 
she " didn't know what that meant." That solved the prob- 
lem. From then on the children were instructed to "Make 
a cross in the BIGGEST square," and the success of the test 
was assured. Brevity is equally essential in giving directions 
to children, for their habits of thinking, of concentrating the 
attention, are not yet formed, and to listen, comprehendingly, 
to long directions is impossible for them. Novelty and change 
are so obviously important in maintaining the interest and 
stimulating the child to his best effort, that further discussion 
of the value of brevity is unnecessary. 

In the selection of group tests, only those should be chosen 
which permit of but one correct response, and that response 
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must have but one possible interpretation. It is true that some 
of the tests consist of several trials of the same sort; thus, 
three different series of five digits each, are read to the chil- 
dren, to be reproduced, but the child passes the test if he suc- 
ceeds in reproducing any one of the series correctly. This is 
a necessary procedure, because it is almost impossible, in a 
group, to have perfect silence while the directions are being 
given ; and so a single series might not be heard by all. Then, 
too, many children have poor auditory imagery, which fact 
makes it difficult for them to reproduce material presented 
orally. However, in all of the tests a response is either en- 
tirely correct or it is entirely wrong. This " All or none " 
method of scoring is used in the writer's group tests, for the 
purpose of the series is not to discover how much better one 
child can perform a given task than another, but to see which 
children fail to perform it at all, i. e., to sort out the subnormal 
children who need to be given the individual tests before a 
correct diagnosis can be made regarding their mentality. 
That the responses must permit of no variation in interpreta- 
tion, due to the examiner's judgment, is undoubtedly as essen- 
tial in group tests as in the individual tests. 

Altogether, twenty-five tests have been selected which seem 
to fulfill the requirements mentioned above. These have been 
divided into groups of five, designated for convenience, as 
five, six, seven, eight and nine year tests. These have been 
g^ven to 904 school children distributed according to age as 
shown in Table I. 

TABLE I. 
Age No. Cases 

6 (i.e., 5 yrs. 6 mos 6 yrs. 5 mos. incl.) 160 

7 n.c., 6 yrs. 6 mos 7 yrs. 5 mos. ind.) 225 

8 (i.e., 7 yrs. 6 mos 8 yrs. 5 mos. ind.) 224 

9 (i.e., 8 yrs. 6 mos 9 yrs. 5 mos. ind.) 175 

10 (i.e., 9 3rrs. 6 mos 10 yrs. 5 mos ind.) 120 



Total 904 

Description of the Tests 
tests for year v 

V, I. Formboard. 

Materials. This is an adaptation of Czoddard's* formboard. 

From heavy white cardboard the ten well-known forms are 

cut. Black paper is pasted over the back of the openings to 

make them stand out more clearly, and then another sheet of 

«Goddard: The Training School. Vol. IX, No. 4, June, 1912, 
pp. 49-54. 
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white cardboard is pasted over all this to form the back. Ten 
little cards which exactly fit the ten forms, are placed in an 
envelope pasted on the back of the formcard. 

Procedure. The examiner holds up a booklet in front of 
the group of children to be tested, and says : 

" Open these little books to this black and white card. 
In the envelope on the back you will find a number of 
little cards. Take these out of the envelope and put them 
in a pile on your desk. Now, there is one place in the 
black and white card into which each of these little cards 
will exactly fit, — like this. (Illustrate with square.) See 
if you can find the place for each of the others." 

Help may be given any child who has difficulty in finding 
the place for each card the first time. When all the children 
have the cards properly placed, have them remove them and 
again place them in a pile on the desk. Then proceed a^ 
follows : 

" Now you know where each little card belongs. This 
time we are going to see who can put all the cards in their 
places first. Everyone wait until I say 'Go,' and then 
work as fast as you can until I say ' Stop.' Then put 
your hands in your laps AT ONCE, without touching a 
single card again. Is everybody ready? Go." 

Allow 50 seconds before giving the signal to stop. Care 
must be taken to see that no child touches a card after he has 
been told to stop. 

Scoring. The test is passed if all ten cards are in their 
proper places at the end of 50 seconds. A plus or minus, 
indicating whether the child has passed or not, can be quickly 
marked on the blank page opposite the form card, by the ex- 
aminer, before having the children replace the cards in the 
envelope. 

V, 2. Counting 4 Circles. (Lowell) 
Materials. A card, 6 in. x 18 in., on which are printed four 
large circles about 2 inches apart, is necessary, and also two 
wooden blocks or other small objects. Space for the child to 
make the crosses is provided at the top of page 2 of the 
booklet. 

Procedure. "When I say, 'Make a cross,' this is what I 
want you to make. (Make X on the blackboard.) If I 
should say ' Make a cross for each of these blocks (holding 
up two blocks), how many crosses would you make? Yes, 
two,— one for this block, and one for that (XX), see?' 
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"On this large card are some circles. When I hold the 
card so you can see them, you are to count the circles TO 
YOURSELVES, and then make as many crosses up here at 
the top of your paper (Indicate) as there are circles. Ready. 
Look." Ejcpose the circles for 10 seconds. 

Scoring. The test is passed if four crosses are made. 

V, J. Copying Square. (Binet)' 
Materials. Use a large cardboard on which an eight inch 
square is printed in heavy lines. 

Procedure. Holding up the large square, and indicating the 
space in the booklet to be used, the examiner says : 

"At this side of the big space, here, see how nicely 
you can make a square just like this one." 
Hold the card so all can see it while they are drawing, and 
then when they have finished one, say: 

" Now see if you can make a still better one at this 
other side of the big space." 
Scoring. The test is passed if one of the two squares drawn 
is as good as those on tiie score card used by Binet. 

V, 4. DiscriminaHng Colors. (Binet) 
Since it is impossible to have children in a group test name 

colors, the following adaptation of Binet's color test was used. 

It necessarily makes a different test from the original, since 

the directions must be comprehended and followed exactly. 
Materials. One-half inch squares of the red, yellow, blue 

and green, arc pasted on page 2 of the booklet in the ordert 

named. 
Procedure. " Look at the colors in the middle of this page. 

Listen carefully, and then do just as I ask you: 

" I. Make a cross in the yellow square, like this. 

" 2. Draw a line through the green square, like this. 

" 3. Now make a cross above the red square, like this. 

" 4. Draw a line under the blue square, like this." 

In order that the child shall understand what is wanted, 
draw a square on the board each time, and do what you tell 
the child to do. Give directions slowly, and repeat each. 

Scoring. The test is passed if all four colors are correctly 
marked. 

^Awnee Psjchologique (1911) vol. 17, pp. 145-201. 
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V, 5. Irregular Tapping. (Pintner,* Kuhlmann.^) 
The present adaptation has been made from the form used 
by Dr. Kuhlmann in his 1917 Revision of the Binet Tests. 

Material, Use a card, 6 in. x 18 in., on which are printed 
four squares, about two inches apart. At the bottom of page 
2 in the booklet are three rows of squares similar to the one 
on the examiner's card. 

Procedure. " At the bottom of the page you see three rows 
of squares. The first row looks like this one, doesn't it? 
(Point to card in hand.) Now I am going to tap some of these 
squares, like this. (Tap the first two squares with a ruler.) 
Watch me carefully, and when I've finished tapping, put a 
cross, like this, X, in just the squares that I tap. Ready. 
Watch." Then tap the squares in Series A in the order 
named, at the rate of one square per second, and allow time 
between series for the child to cross the squares tapped. Al- 
ways tell the children which row of squares to use for each 
series. 

A) 1-2-4 

B) 1-3-4 

C) 2-3-4. 

Scoring, The test is passed if one of the three rows is 
correctly marked. 

TESTS FOR YEAR VI 

VI, I, Aesthetic Comparison, (Binet) 
Material, On each of the pages 3, 4 and 5 of the booklet 

are two pictures used by Binet for the comparison. 
Procedure, "Look carefully at the two pictures on this 

page (3). Make a cross imder the prettier one of the two." 

Give the same instructions for each of the pages 4 and 5. 
Scoring. The test is passed if the prettier face is indicated 

in two of the three series. 

VI, 2. Mutilated Pictures. (Binet) 

Materials. The four pictures used by Binet are printed on 
four successive pages in the booklet, 6, 7, 8 and 9. 

Procedure. " Look at this picture. (Page 6.) Part of the 
face is gone. Let us see what part it is. You see the eyes. 
Look, the eyes are there. You see the nose. Yes, the nose 
is there, and look, the chin is there. Now what part is gone? 

• Pintner : A Scale of Performance Tests — 1917. 
f Kuhlmann: The Measurement of Mental Development — A School 
Publication — Faribault — 1917. 
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(Children name mouth.) Yes, the mouth is gone. Now 
make a cross right where the mouth should be, to show that 
that is the part that is gone. 

** Look at the next picture. Do not tell me this time what 
is gone, just make a cross to show me what part is missingi 

" Make a cross to show what is gone from the next picture 
(Page 8.) 

"And now show what is gone in the last picture." (Page 9.) 

Scoring, The test is passed if the last three pictures are 
correctly marked. 

VI, 3. Counting Irregular Taps. (Kuhlmann) 

Materials. The examiner needs a wooden block or the 
blunt end of a pencil for tapping. Ruled blanks are provided 
the children on page 10 of the booklet. 

Procedure. " Listen. I am going to tap on the table and 
see if you can count the number of taps. You count to your- 
selves, and give me the number when I ask you. Ready." 

Tap 5 times, at the rate of one tap per second. See that 
the hand is screened, while tapping, by a large cardboard. 

" How many times did I tap ? Five, that is right. Now, 
instead of telling me how many times I tap, I want you to 
make a cross for each tap, when I get all through. I just 
tapped five times, so how many crosses shall I make to show 
it? Yes, five, like this: XXXXX. 

" Sometimes I will stop tapping and then begin again. 
Don't let that fool you. You count only those you hear, and 
when I ask how many, you will make one cross for each tap, 
here, on this first line. (Indicate linfe each time.) Ready. 
Listen." 

Tap the following series in order, at the rate of one tap per 
second, for each cross, and pausing a second for each dash: 

1) XX-XX (4) 

2) X-XX-XXX (6) 

3) XXX-X (4) 

4) XX-XXX-X (6) 

5) X-XX-X-X (5) 

Scoring. The test is passed if 3 out of the five series are 
correctly counted as indicated by the correct number of crosses. 

VI, 4. Two Simultaneous Commands. 
This test was suggested by Binet's test in which three 
simultaneous commands were used. 
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Materials. One row of circles and a row of squares of 
different sizes are provided for the children on page 10 of the 
booklet. 

Procedure. " See these squares and circles. Listen care- 
fully and see if you can remember what I am going to ask 
you to do with them, when I am all through telling you. 

" Make a cross in the BIGGEST square. 
Then draw a line in the FIRST circle. 

" I will tell you once more, and then see if you can do both 
things. Listen : 

" Make a cross in the BIGGEST square. 
Draw a line in the FIRST circle." 

Scoring. The test is passed if both directions are correctly 
followed. 

VI, 5. Perception of Sound. (Lowell) 

Material. A bean-bag, a baseball, a penny, a pencil, a key, 
and a wooden block are used. Have a table which can be con- 
cealed from the children and from which the above named 
objects can be dropped. A card picturing each of the objects 
with respective symbols to be drawn by the children, is tacked 
up in view of the children. See Fig. I. Space for six draw- 
ings is provided at the bottom of page 10 in the booklet. 

Procedure. " What is this ?" 

Hold up each of the objects and have the children name it. 

" Now look at this card (Fig. I), and tell me what each of 
these pictures is. (Have them name them all.) 

" Now I am going to drop each one of these on the floor] 
where you cannot see it, and I want you to listen to the noise 
each makes, and see if you can tell which of these I drop. 

" If I should drop the bean-bag first, you would draw, in 
this first space, here, this. (Point to symbol at the side of the 
picture of the bean-bag) ; if I dropped the key next, you would 
make this X in the second space, here ; if I dropped the penny 
next you would make this line in the third space, etc. 

" Now shut your eyes, and see ii you can tell from the sound 
which one of these I drop, and then look at the card to see 
what to draw. Then draw that in the first space. Ready. 
Listen." 
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Drop objects in the following order : 

block 

bean-bag 

penny 

key 

ball 

pencil 

Scoring, The test is passed if five out of the six objects are 
named in the correct order. 

TESTS FOR YEAR VII 

VII. I, Number of Toes. 

Because it is impossible to prevent a large group of children 
from counting their fingers if one were to use the original 
Binet test, the number of toes on each foot and on both feet 
together, has been substituted. 

Procedure. " I am going to ask you some questions, and I 

want you to write the answers, here at A) , at B) 

and at C) Ready: 

A) How many toes on your left foot? 

B) How many toes on your right foot? 

C) How many toes altogether on both feet?" 

Scoring. Since most children of seven years can make fig- 
ures up to 10, further use of crosses in answering questions 
is not permitted. The test is passed if the answers to all three 
questions are correct. 

VII, 2. Memory Span. (Binet) 

Procedure. " I am going to read you some numbers. 
Listen carefully, and see if you can write them when I get 
through just the way I read them." 

Read the digits at the rate of one digit per second, without 
rhythm. 

" Listen : 

A) 6-5-2-8-1 

B) 4-9-3-7-5 

C) 2-8-6-1-9" 

Scoring. The test is passed if the digits in one series are 
correct, even though their order be changed. 
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VII, 3. Copy Diamond, (Binet) 
Material. Use a card on which a large diamond, 9 in. x 
18 in., has been drawn in heavy lines. 

Procedure. "At the left side of this big space, see how 
nicely you can draw a diamond just like this one." 

Hold the card so that all can see it as they draw. After they 
have finished drawing the first diamond, say : 

" Now draw another one at the right side of the big 
space just like this one." 
Scoring. The test is passed if one of the two drawings is 
as good as those on the score card used by Binet. 

VII, 4. Tying Bowknot. (Binet) 
Material. Two pieces of tape, each about seven inches in 
length, are fastened to a stiff card pasted at the bottom of 
page 11, in the booklet. 

Procedure. " You know what kind of a knot this is, don't 
you? (Show them bowknot already tied). Yes, it is a bow- 
knot. I want you to tie the same kind of a loiot with the 
pieces of tape you have, just as quickly as possible." 
Scoring. The test is passed if a bowknot is correctly tied. 

VII, 5. Geometrical Figures. (Lowell) 

Material. Use five cards, on which are printed, in a differ- 
ent order, on each card, a circle, a square, a cross, and a tri- 
angle. See Fig. II. 

Procedure. " I shall show you some cards for ten seconds 
each. On each card you will find these forms. (Draw on 
blackboard.) But the order in each case will be different. On 
one card a square will come first, and on another card the 
circle will come first, etc. You -will notice carefully the order 
of the forms, and when I take the card away, you will draw 
what you saw in just the order it was on the card. Draw as 
quickly as possible. Ready. Look at the first card." 

Allow no more than one minute for reproducing a card. 

Be sure all children are giving attention when you hold up 
a card. 

Scoring. The test is passed if three of the five series are 
correctly drawn. 

TESTS FOR GROUP VIII 

VIII, I. Ball and Field. (Terman) 
Material. The incomplete circle used by Terman to repre- 
sent the baseball field, is printed in the booklet. 
Procedure. "Let us suppose that your baseball has been 
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lost somewhere in this round field. You have no idea 
what part of the field it is in. All you know is that the ball 
is lost somewhere in this field. You are to mark out a path 
to show me how you would hunt for the ball so as to be sure 
not to miss it wherever it might be. If you draw just a line 
to the center from the gate, like this, — ^it would mean that you 
only looked that far and then stepped, — and the ball might be 
away over at the other side ; you don't know where it is. Now 

on XA 

DXAO 

AO DX 
XDOZ\ 

OAX a 



Figure IL (vii, s) 
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begin at the gate, and with your pencil mark out a path to 
show how you would hunt for the ball so as to be sure not 
to miss it." 

In giving an individual child this test, according to Dr. 
Terman's directions, the examiner watches what the child 
draws, and if he stops after drawing just a short path, the 
examiner asks him where he would go next if he hadn't yet 
found the ball. As such procedure is obviously impossible 
with a large group of children, the illustration is used in the 
directions. 

Scoring. The test is passed if the child shows a plan as 
good as those shown on Terman's score card for eight-year- 
old children. 

VIII, 2, Writing from Dictation. (Binet) 
Procedure. " I want you to write something for me as 
nicely as you can on this long line. Write these words : * See 
the little boy.' Be sure to write it all : * See the little boy.' " 
Scoring. The test is passed if the sentence is written legibly 
enough to be easily read, and if no words are omitted. Unless 
a word is so incorrectly spelled as to make it unrecognizable, 
the error is not counted. 

VIII, 3. Counting the Value of Stamps. (Binet) 

Material. Use a cardboard on which have been pasted 
three one-cent stamps in a row at the top, and three two-cent 
stamps in a row under these. 

Procedure. "Write the answer to this question on the 
short line here." Hold the card before the children and say : 

" How much will it cost to buy all these stamps ? A green 
stamp is worth one cent, and a red stamp is worth two cents. 
Now, how much are they worth altogether? " 

Scoring. Test is passed if the answer, 9 cents, is given. 

VIII, 4. Comprehension Test. (Kuhlmann) 

Material. Three one-inch squares are printed in the book- 
let on page 3. 

Procedure. Point to the parts as you mention them. 

"See this first square. This is the center of the square. 
What is it? This is the upper right corner of the square. 
What is it? This is the lower left comer. What is it? This 
is the middle of the left side of the square. What is it? 

" Now take your pencils, and draw a straight line from the 
center of the first (second and third) square to: 

1) The upper left comer. 
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2) The middle of the upper side. 

3) The lower right comer of the square." 

Scoring. The test is passed if two of the three lines are 
correctly drawn. 

VIII, 5. Estimation of length of lines. (Kuhlmann) 
Material. On separate pages of the booklet are drawn 
three lines. The first line, drawn vertically in the center of 
the page, is three inches long ; the second line, similarly drawn 
on another page, is two and one- fourth inches long; and the 
third line, drawn horizontally, and having two curves, is 
three inches long. 

Procedure. " I want to see how well you can judge the 
length of lines without a ruler or even your pencils to help 
you measure. Look at this line carefully, and then draw a 
line under it here, horizontally, i. e., from left to right like 
this, (hold pencil where line is to be drawn), which is 

1) Just as long and no longer than this line. 

" Now look at this next line. Draw a line under it, here, 
horizontally, which is; 

2) Just twice as long as this one. 

3) "Let's play that this is a piece of string. If I 
could take hold of the ends of it, and pull the string out 
straight, how long a piece would it be ? Draw a straight 
line here, to show how long it would be." (Point to space 
imder the curved line.) 

Scoring. The test is passed if two of the three lines are 
drawn within one-half inch of the required length, i. e 

1) 3 in. 

2) 4y2 in. 

3) 3 in. 

TESTS FOR GROUP IX 

IX, I. Drinking Cup. (Bureau of Analysis, etc., N. Y.)* 
Material. A square of white paper, 7>4 x 7yi in. 
Procedure. " I am going to show you how to make a drink- 
ing cup, and when I finish, I want you each to make one just 
like it. ^atch carefully. 

1st : Fold the square through the center like this. 
2nd: Take the right hand comer and fold it over to 
the opposite side so that these two edges are equal. 

'New York State Board of Chanties, Bureau of Analysis and 
Investigation : Eleven Mental Tests Standardized, 1915, Eugenics and 
Social Welfare Bulletin No. V. p. 42. 
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3rd: Next, take the other comer on the left side, 
and fold it over the sanie way so that the edges come 
straight across. 

4th: Then, fold down this flap, and put it into this 
outer space to hold it. 

5th : Now fold down the top flap for a cover, and you 
see how the cup looks. 

" You take your square of paper now, and make one." 
Scoring, The test is passed if the five folds of the drinking 
cup are correctly made. 

IX, 2, Maze. (Porteus)* 
Material, The maze used by Porteus for nine year children, 
is printed in the booklet. See Fig. III. 
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Figure III. (ix, 2) 



Procedure. " Here you have a maze. Some of these paths 
are open, so you can get through, and some are closed at the 
ends. See how quickly you can find the shortest way out, 
without getting into any of the closed paths. Start where you 

•Porteus: Mentel Tests for Feeble Minded; Journal of Psycho- 
Asthenics, Vol. 19^ No. 4, June, 191 5, pp. 200-213. 
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see the letter S, and mark out the very shortest path you can 
find in order to get out over here on the other side. Do not 
stop to erase an)rthing. If you make a mistake, just draw a 
line across it and go on as fast as you can." 

Scoring. The test is passed if the shortest path is marked 
out in one minute, with not more than two errors. An error 
consists of a line, however short, drawn out from the shortest 
path. 

IX, J. Tapping Squares. (Whipple) *« 
Material. A sheet of paper is used on which a rectangle 
has been printed. This rectangle is divided into 150 half -inch 
squares, arranged in ten rows of fifteen squares each. 

Procedure. " Please take your pencils and hold them firmly 
about half way up. Place your arm comfortably on the desk 
so that it may bend freely at the elbow. Now when I say, 
* Ready,' you are to tap as many squares as you can, in order, 
without hitting any square twice, or missing a square, or 
touching any of the lines. Work imtil I say ' Stop.' " 

Scoring. The test is passed if 50 squares are correctly 
tapped in the 30 seconds allowed. 

IX, 4. Alphabet Test. (Kuhlmann) 
Procedure. " Of course you all know the letters of the 
alphabet, a-b-c-d-e etc. Who can tell me what is the first 
letter before *C'? (B). Now who can tell me what is the 
sixth letter before 'X'? (R). Let us put this one on the 
beard, R-S-T-U-V-W-X. Notice that W would be the first 
letter before X, V the second, U the third, T the fourth, S the 
fifth and R the sixth. 

" I will give you 30 seconds to answer each one of these 
questions. 

i) What is the 3rd letter before K (H) 

" W (R) 
" F (D) 

" Q (P) 
" E (A) " 

Always write the letter to be used as a basis on the board, 
so that the children will not misunderstand. 

Scoring. The test is passed if three of the five letters are 
correct. 

!• Whipple : Manual of Mental and Physical Tests, 1910. pp. 100- 
115. 
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IX, 5. Memory Test. (Kuhlmann) 
Procedure. " I am going to write five words on the board, 
and let you look at them for a few seconds. Then I will erase 
them and write five others and let you look at them, and so 
on with the other series. When I am through, I will give you 
the first word of a series, and you are to write down from 
memory, the other four words that go with it. Then I will give 
you the first word of the next list, and you will write the 
four that go with that one, etc. You must not write down any 
until I tell you to." 

Let them look at each series for 30 seconds, then erase and 
take the next. Give them 30 seconds to recall each list. The 
lists are: 



Silver 


red 


kitchen 


blackboard 


lawn 


spoon 


cow 


stove 


teacher 


grass 


table 


fence 


flour 


desk 


tree 


bread 


clover 


water 


slate 


house 


fork 


dog 


spoon 


lesson 


walk 



Scoring. The test is passed if the child gives three series 
without more than one error in each. An omission counts as 
an error. 

Difficulties of Administering Group Tests 
Many problems, which from their very nature can never be 
entirely eliminated, arise in giving group tests to the primary 
grades. Some of these difficulties are due to the distractibility 
of young children, to their inability to comprehend directions 
readily, to their undeveloped moral sense, to the attitude of the 
teacher, and to the apparent inhibition of response which the 
nervous child exhibits. 

The inability of the young child to attend to set problems 
for any length of time is a serious difficulty. It necessitates 
devoting almost the entire first year of his school life to the 
formation of habits of work, of play, of thought and of living. 
Up to the time of his entrance into school, he is permitted to 
eat, sleep, and play lai;gely at will, but with the beginning of 
his educational career he is expected to live according to a 
more or less definite plan, regardless of his own wishes or 
pleasures. When a stranger tries to test forty such children, 
before regular habits have been formed, the difficulties en- 
cotmtered may easily be imagined. Usually, the children are 
sufficiently shy and timid not to need disciplining, but some- 
times that very timidity prevents them from being responsive 
at first. Therefore, their confidence must be won by the time 
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the booklets are distributed and the examiner is ready to begin 
the testing. The fact that the children are not permitted to 
look through the pages except as they use them for the tests 
helps to keep up the interest. When the booklets are finally 
distributed, the directions for the first test given, the children 
attentively (?) awaiting the signal to begin work, and then a 
little voice in the comer confidentially informs one that " My 
sister has some gold beads just like yours," the examiner 
wonders if he can ever be sure of a child's attention. 

The difficulty experienced by young children in compre- 
hending directions has been discussed under the " Selection of 
Tests." Frequent illustrations, full and explicit directions 
with numerous repetitions, all help the child in understanding 
what he is to do. However, ability to comprehend and follow 
directions accurately, is a test of intelligence, and too many or 
too great a variety of instructions may destroy the value of 
the test. 

In order to stimulate the child to his bes.t effort, one appeals 
to his competitive instinct, his sense of rivalry. This has its 
disadvantages, for the child in his eagerness to do better than 
his neighbor, or to get a word of praise from the examiner, 
resorts to methods " fair or foul." It is generally agreed that 
the young child is non-moral. The disapproval of the group 
has not been experienced sufficiently to make a lasting impres- 
sion; and so the child slyly copies from his nei^bor, or 
covertly writes on his desk the digits which are being read. 
To guard against such conditions as these, the writer has used 
various devices. Some have been mentioned under Procedure, 
such as having the child place his hands in his lap the instant 
he is given the signal to * Stop ;' cover his work with his 
hands as soon as he has finished the task assigned ; or, in the 
digits test, place the pencils on the desks and leave them 
there until told to write. In one or two instances, where the 
attention had several times been called, without effect, to the 
fact that someone in the room was not playing fair, more 
drastic measures have been taken, such as speaking to the 
child by name, or changing his seat However, as most chil- 
dren are very sensitive to criticism, such measures are seldom 
necessary. 

Frequently a teacher, not knowing the object of the group 
testing, feels that unless the pupils respond well to the tests, 
her reputation as a teacher will be at stake. In her anxiety to 
have the children make a good showing, she offers sugges- 
tions which help them. For example, when trying out various 
tests for the nine-year group, the writer used Terman's test 
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of finding all the words that rhyme with "Day, mill and 
spring." In one third grade, the teacher felt that the children 
were not responding as readily as they should, so with much 
irritation she spoke to the class. " Why, children, you know 
how we have been finding words to go in the * ING ' family, 
so I don't see why you can't find others like * Day ' to go in the 
*AY' family." Of course the children could find words 
after that, but the test, as such, had lost its value. To avoid 
such incidents, the examiner should explain to the teacher at 
the outset that the purpose of the work is to see what each 
child can do by himself, without any suggestions from her. 

So far, no difficulty has been experienced in securing the 
proper attitude on the part of the child, for the interest and 
novelty of the tests counterbalance any temperamental dis- 
turbances. However, it has been evident in the cases of sev- 
eral nervous children that the excitement produced by the 
competition, novelty and mental effort has inhibited responses, 
especially where the test has a time limit If a pupil happens 
to be an only child and has not yet learned to adapt himseTf 
to an environment in which there are many children, he may 
fail to make an average score in the group tests, though when 
tested individually he may test even above normal. 

Table of Norms and How to Use It. 

If group tests are to be of value in selecting subnormal chil- 
dren, the number of tests passed by an individual must corre- 
late with his age and intelligence. Table II shows the average 
number of tests passed by children of each chronological age 
and of the various I. Q.'s found in Grades I, II, and III. i/^ 

As shown by the above table, the chronological ages of the 
children ranged from six to twelve yearsi By six years is 
meant all ages from five years six months to six years five 
months, inclusive; by seven years is meant all ages from six 
years six months to seven years five months, inclusive; etc. 
In order that the average number of tests passed by children 
of any age might serve as an index of their intelligence, indi- • 
vidual I. Q.'s were obtained by means of Dr. Kuhlmann's 
1917 Revision of the Binet tests, and then the average niun- 
ber of group tests passed for tfiese various intelligence quo- 
tients and for each chronological age was computed. Thus, 
in using the table of norms in classifying an individual case, 
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TABLE II 
Norms. Average Number Tests Passed at Various Ages and Grades 

Grade L (Group Tests V— VI— VII.) 
I. Q. 6 yre. ^ 7 yre. 8 yre.- 9 yrs. 10 yre. 11 yra. 



.70.\... 
.80.i... 


2.0 


4.6' 


6.a.> 


8.3 




4.3 


6.6 


9.6- 


11.1 




.90 


6.1 


8.4 


11.8 


.... 




1.00 


7.7 


11.2 


•14.5 


.... 




l.IO 


8.2 


12.6 




.... 




1.20 


10.5 


14.0 


.... 






1.30 


13.0 


15.0 


.... 


.... 




I. Q. 


Grade II. 


(Group Teste VI- 


-VII— VIII.) 


.70 






7.3 


8.6 10.1 


.80 






8.8 


11.0 12.0 


.90 





8.6 


9.9 


12.4 14.2 


1.00 




9.6 


11.4 


13.7 


1.10 




10.1 


12.5 


14.5 


1.20 




11.5 


13.5 


.... 


1.30 


i2;6 


13.3 





.... 


1.40 


13.4 


15.0 





.... 


I.Q. 


Grade III. 


(Group Teste VII- 


-VIII— IX.) 


.70 








8.0 9.8 


.80 




• • • • 


8.5 


9.2 10.8 


.90 




• • • • 


9.5 


10.2 11.9 


1.00 






10.0 


12.0 13.0 


1.10 




.... 


12.0 


13.5 14.2 


1.20 






13.1 


14.6 


1.30 




12.6 


14.2 


.... .... 


1.40 




14.0 









10 

11 



one compares the number of group tests passed by him with the 
average nimiber of,tests passed by children of the same grade 
and chronological a^feT^and finds the average in the series and 
its corresponding I. Q., with which his score agrees. For ex- 
ample, if an eight-year-old child in the first grade passed only 
seven tests, his score would lie between the average for chil- 
dren of his age who had an I. Q. of .70, namely 6.2 tests, and 
the average of those with I. Q. of .80, or 9.6 tests. This would 
give him a group I. Q. of .72. Since such a rating would place 
him in the sub-normal groupj he should undoubtedly be given 
the individual Binet tests, in order that his mental status be 
accurately gauged. 
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Reliability of the Group Tests 
In order to determine the reliability of any series of tests, 
the data must be considered from various points of view.. 
The aspects whidh will be discussed in connection with the 
reliability of the present scale are; first, the discriminative 
capacity of the tests, i. e., their ability fo distinguish between 
children of various ages, as shown by the increase in the per ^ 
cent passing the tests for successive chronological ages ; X' 
second, the percentage of children passing " at age," i. e., the 
percentage which will cause average six-year-olds to show a 
mental age of six years, average seven-year-olds to show a»K 
mental age of seven years, etc., as compared with the percent- 
age passing at age in the individual ttstsc/third, the ability of 
the group tests to discriminate between various mental ages 
in three school grades where the same group of tests has been 
given; fourth, the correlation between group and individual 
tests, as calculated by Karl Pearson's method ; fifth, the agree- 
ment between group test results and school attainment; and 
sixth, the correlation between the writer's scale and an " Abso- 
lute Point Scale," ** when used on the same children. 

The Increase in Per Cent Passing- for Successive 
Chronological Ages 

The discriminative capacity of group, as well as of indi- 
vidual tests, is measured by the increase in the percentage of 
children passing the tests from one age to the next. The 
greater the increase in the percentage passing any test from 
one age to the next, the higher is the discriminative capacity 
of that test. 

Table III compares first, the percentage passing at age for 
each test in the five age groups, with the percentage of children, 
chronologically a year older, passing each test^^and second, 
it compares the per cent increase from one chronological age 
to the next as found in the group tests, with the pei* cent in- 
crease found by Kuhlmann ** and Terman,*' where they have 
used the same tests in their revisions as individual tests^ For 
example, 66 per cent of the six-year-old children passed the 
aesthetic comparison test (VI,1) when given in the group, 
and 75 per cent of the seven-year-olds passed it, thus giving 

" G. Arthur and H. Woodrow : An Absolute Point Scale. /. AppL 
Psychol, Vol. 3, 1919, pp. 1 18-137. 

*2 These figures were taken from results in Dr. Kuhlmann's 1912 
revision, in which the tests had not been correctly placed in the scale. 

I'Terman's results as quoted are taken from the data published in 
1917 on the Stanford Revision. 
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an increase from one age to the next of 9 per cent. WheJn) 
Kuhlmann used it as an individual test, he found an increase 
of 4 per cent passing from ages six to seven, and Tertnan 
found an increase of 6 per cent at the same ages. 

TABLE III 

Increase in Per Cent Passing for Successive Chr(»khjogical Ages 

Yr. 6 Yr. 7 % Individual % Increase 

Group V (121cases) (135cases) Increase Kuhlmann Terman 

1. Formboard... 65 84 19 

2. Counting 4 Cir- 

cles 66 87 21 

3. Copying square 85 95 10 

4. Discriminating 

Colors 72 81 9 

5. Irregular Tap- 

ping 70 85 15 

Yr. 6 Yr. 7 % Individual % Increase 

Group VI. (122cases) (136ca8es) Increase Kuhlmann Terman 

1. Aesthetic Com- 

parison...... 66 75 9 4 6 

2. Mutilated Pic- 

tures 63 74 11 6 15 

3. Irregular Tape. 60 88 28 

4. Two Com- 

mands 54 75 21 

5. Perception of 

Sound 51 74 23 



.^^ Yr. 7 Yr. 8 % Individual % Increase 

"^ Group VII. (95 cases) (198case8) Increase Kuhlmann Terman 

1. No. of Toes. . . 70 88 18 17 9 

2. Memory Span. 63 81 18 3 6 

3. Copy Diamond 84 92 8 11 18 

4. TyingBowknot 72 81 9 .. 16 

5. Geom. Figures. 61 76 15 

Yr. 8 Yr. 9 % Individual % Increase 

Group VIII. (199case8) (174ca8es) Increase Kuhlmann Terman 

1. Ball and Field. 70 79 9 .. 7 

2. Dictation 78 87 9 .. 8 

3. ValueofStampe 70 84 14 20 17 

4. Comprehension 

Test 72 81 9 .. 

5. Length of Lines 69 81 12 
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Yr. 9 Yr. 10 % Individual % Increase 

Group IX. (106cases) (112cases) Increase Kuhlmann Terman 

1. Drinking Cup.. 67 78 11 

2. Maze 73 83 10 

3. Tapping 

Squares 70 79 9 

4. Alphabet Test. 73 83 10 

5. MemcMTTest. 60 71 11 

Unfortunately, there are no other similar group tests pub- 
lished, with which the writer's percentages passing the various 
tests can be compared. However, there is about as much 
variation existing between the data from the two revisions 
of the Binet Scale as between the individual and group results. 

Per Cent Passing " at Age " in Individual and Group 

Tests 
Considerable difference exists between the percentage of 
children passing " at age " in the group and in the individual 
tests. Kuhlmann has found that a much higher percentage 
of young children pass " at age " than of the older ones ; thus, 
he found that 88 per cent of the four-year-old children pass 
the four year, tests, whereas only 54 per cent of the twelve- 
year-olds pass the twelve year tests. However, in the group 
tests, the writer finds as small a percentage of six and seven 
year children passing six and seven year tests, as of nine-year- 
old childrtti passing the nintf year tests. Table IV compares 
the percentages passing " at age " as found by Kuhlman ** in 
the Individual ffests with those by the writer in the Group 
' Tests. Thus, 78 per cent of the six-year-old childrwi pass the 
six year Individual Tests, and only 60 per cent of them pass 
the six year group tests. 

TABLE IV 

Per Cent Passing at Age in Individual and Group Tests 

C.A. 6Yr8. 7Yr8. 8 Yrs. 9 Yrs 

Kuhlmann— Individual Tests . 78 73 68 64 

Lowell— Group Tests 60' 69 72 68 

The explanation of these differences in the six and seven 
year results may be found in the fact that a group test is 
largely a matter of comprehending and following directions 

** These figures were given me through the courtesy of Dr. Kuhl- 
mann, from his manuscript of " The Measurement of Mental Develop- 
ment, a further Extension and Revision of the Binet-Simon Tests" 
to be published soon. 
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presented orally, without any individual help for individual 
needs. If a child has not been accustomed to doing things in 
a group, he will be easily distracted. Then, too, the younger 
the chUd the less capable he is of following instructions; but 
with each additional year of experience, and with an increas- 
ing mental age, the performance of tasks become easier. The 
effect of these two factors, namely, increasing mental age and 
increasing number of years in school, on the number of group 
tests passed, is shown in Table V. 

TABLE V 

Relation op M. A., No. Years in School and Av. No. of VII Year 
Group Tests Passed 

Average Number of Tests Passed in : 
M.A. Grade I Grade II Grade III 

4 — 4.9 years 

5 — 5.9 years 

6— 6.9 years 

7— 7.9 years 

8— 8.9 years 

9— 9.9 years 

10—10.9 years 

The data for the above table was obtained by testing 277 
children individually, with Kuhlmann's 1917 Revision, — ^thus 
getting their mental aggs. . Therf the average number of tests 
in the VII year groupr— this group was the only one of the 
three which was given in all three grades — ^passed by children 
of the various mental ages, was found for each grade. Thus, 
children with a mental age of 6 — 6.9 years, who have been in 
school less than one year, — that is, who are in the first grade, 
on the average pass 1.2 tests of the VII year group; children 
of the same mental age who have been in school nearly two 
years, or are in the second grade, pass 3 tests ; and those in 
the third grade, of the same mental age, pass 3.3 tests. So, 
with each additional year in school the number of tests passed 
increases, even though the mental age remains constant. On 
the other hand, with the " time in school " factor constant, 
but with increasing mental age, one also finds an increase in the 
number of tests passed. Thus, in grade I children whose mental 
age is 4 — 4.9 years will not pass any of VII year tests ; those 
whose mental age is 5 — 5.9 will average 0.7 of a test ; whereas 
those having a mental age of 8 — 8.9 will average 4.0 tests. 

These facts seem to indicate that two important principles 
are involved in the group responses of primary children. 
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First, that the distractibility, so noticeable in kindergarten 
and first grade children, gradually decreases with each addi- 
tional year of group or school performance, until it becomes, 
in the third grade, a negligfible factor. In other words, the 
individual third-grade child has had time to adjust himself 
to his new environment, and to realize through frequent en- 
counters with other members of the group, that his wishes 
and his behavior must conform to theirs. Second, mental age 
is an important consideration. This is true, however, only 
in so far as the work is sufficiently difficult to require efifort 
on the part of the individual. Thus, in the third grade, taking 
carelessness and chance error into account, the maximal per- 
formance is reached, for the VII year tests, at a mental age 
of eight. Further increase in mental age does not improve 
the average eight year score. 

Correlation Between Group and Individual I. Q.'s. 

Since the standardization of the group tests has been com- 
pleted, the writer has given the group tests to 153 children in 
the primary grades and found thfiir group I. Q.'s. Then all 
of these children were tested individually *by Kuhlmann's 1917 
Revision of the Binet tests, and their individual I. Q.'s worked 
out. The coefficient of correlation, computed by Karl Pear- 
son's method, for the two series of I. Q.'s is ,77, 

Group and Individual I. Q.'s vs. School Attainment 
Individual records in group tests form a basis for promotion 
in primary grades, for the results obtained by group tests 
agree more closely with school attainment than do the results 
obtained by individual Binet testing. As a rule, children who 
give poor response to group tests, do poor school work, while 
those who obtain group I.Q.'s above 1.10 are capable of 
special promotion. 

On the basis of Terman's " classification of normal or aver- 
age children, namely, those having I.Q/s from .90 to 1.10, 
the 153 children mentioned above were grouped into three 
classes. Those having individual I.Q/s below .90 were called 
dull, those with I.Q/s from .90 to 1.10, inclusive, were con- 
sidered average or normal, and those with I.Q/s above 1.10 
were classed as superior. Then these cases were redistributed, 
on the basis of group I.Q/s, into the same three classes. A 
comparison of the results is given in Table VI. 

** L. M. Terman : The MeasMrement of Intelligence, 1916, p. 94. 
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Table VI 
Classificatiqn of 153 Cases by Group and Individual I. Q's. 

DuU (Below .90) Average (.90 to 1.10) Superior (1.10+) 
By: No. Cases No. Cases No. Cases 

Individual LQ.'s.... 27 80 46 

GroupLQ.'s 49 66 38 

By this table, one notes that 22 more cases are rated as dull 
by the group scores than by the Binet I.Q.'s. School records 
of these 22 children offer the following bits of information: 

RR." 

Very poor school work, Marks average 70-76. 

R. 

RR. 

Deaf, — Whence class work unsatisfactory. 

RRR. 

School work just passing— even with aid of special 

help. 
R. 
Conditioned in grade. Neuropathic heredity. Does 

nothing in group, and only with much coaxing 

can information be elicited when the child is 

alone. 
R. 
R. 
Father of child f.m. — one brother an idiot — an 

aunt an idiot. 
R. 
R. 
Has very poor comprehension. Has to have much 

individual help. 
R. 
R. 
RR. 

Stammers very badly. 
Conditioned. Can only make grade with individual 

help. 
R. 
R. 

^*R = repeated work of grade. , 

RR = repeated twice the work of the grade. 

RRR = repeated three times the work of the grade. 
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Of the 66 cases classed as normal by the group tests, 53 
receive a similar rating by the individual tests, and the other 
13 were classed as superior. One must remember in this con- 
nection that a difference in an I.Q. of one point may change 
a child's rating from dull to normal or from normal to 
superior. For instance, a group I.Q. of 1.10 will place a 
child in the normal group, whereas an individual I.Q. of 
1.11 would classify him as superior, and vice versa. A differ- 
ence in classification due to a difference of 3 points or less 
between group and individual I.Q.'s occurred in 5 of the 13 ^ 
cases mentioned above. The school records of the other eig^t 
give the following comments : 

Case 1. Slow to respond. Never volunteers to recite in 

class. 
Case 2. Schoolwork inferior to Individual I. Q. Does poor 

team work. 
Case 3. Lazy and careless • — will not work if possible to 

avoid it. 
Case 4. Doesn't work well in group — wants attention cen- 
tered on self. 
Case 5. Has been in school less than one year. Spent one 

day in each of Grades I and II and then was 

located in grade 3B. 
Case 6. R. 
Case 7. Can't adjust to conditions in a group either at work 

or play. Is irritable and nervous. Mother in- 
^ « ^ sane. 
Case 8. R. 

Agreement is very close between Group and Individual 
ratings of the superior group. - One interesting case is fotmd 
on school records for this class, namely that of a child who 
was doing such good school work that the teacher recom- 
mended* a special promotion for him, although his I. Q. as 
determined by the Binet tests did not warrant it In view of 
his excellent school work, and of the fact that when given the 
group tests his score placed him in the superior group, the 
diild was given the extra promotion. He has been in the new 
g^de nearly two months and is still doing superior work. 

Careful consideration of available school records seems to 
indicate and in fact, to emphasize a closer agreement between 
group test results and school attainment than between Binet 
scores and school work. Such a correspondence is to be ex- 
pected, however, when one realizes that the principles involved 
both in group testing and in school work are fundamentally 
the same. 
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Correlation Between Two Group Intelligence Scales 
While the present writer has been devising and standard- 
izing a group intelligence scale by the " all-or-none " method, 
an "Absolute Intelligence Scale"" has been constructed in 
which a point method has been used. Nine well known types 
of tests have been used, namely : 

1) Immediate Memory Span 

2) Easy Opposites 

3) Hard Opposites 

4) Substitution 

5) Word Building 

6) Language Completion 

7) Anagrams 

8) Cancellation 

9) Comprehension 

Without discussing the mathematical calculation of their 
points, a fairly accurate idea of the general plan of the scale 
may be obtained from the following quotation: 

" The quotients which we have termed discriminative values 
represent an absolute increase in ability from one age to the 

next, for their respective tests. The final absolute 

intelligence scale is secured simply by adding to- 
gether the point scales of the individual tests. The normal 
absolute intelligence for any age is simply the sum of the 
normal point scores of that age for all nine tests." 

This point scale differs from the all-or-none scale in prac- 
tically every detail except that both are Group Intelligence 
Scales, and both can express their scores in terms of intelli- 
gence quotients. The two series of tests were given to a group 
of 77 children, and I. Q.'s for each scale computed. The co- 
efficient of correlation between the two groups of I. Q.'s is 
0.76 (Karl Pearson.) 

Summary 

The present group scale offers a means for measuring the 
intelligence of large groups of children accurately enough to 
sort out all children of questionable normality. It also forms 
a basis for school promotion and demotion in the primary 
grades. 

It consists of 25 tests, arranged in groups of five, and for 
convenience, called five, six, seven, eight and nine year tests. 

^7 Grace Arthur and Herbert Woodrow: An Absolute Intelligence 
Scale. The writer is indebted to Miss Arthur and Dr. Woodrow for 
their cooperation in comparing group results and for making their data 
available for the writer's purposes. 
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The tests have been standardized on the basis of results ob- 
tained from 904 children of the ages five years six months to 
ten years and five months, inclusive. 

The uncorrected coefficient of correlation (Pearson) be- 
tween measurements made, in terms of intelligence quotients, 
by the Group Scale and by Kuhlmann's 1917 Revision of the 
Binet Tests is 0.77. 

The group results form a more accurate index of the child's 
performance, than do the individual results obtained by the 
Binet tests. 

The uncorrected coefficient of correlation between two 
series of I. Q.'s obtained for 77 children by the present group 
scale and by "An Absolute Point Scale " is 0.76. 
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A STi^NDARDIZED TEST FOR OFFICE CLERKS 



By L. L. Thubstone, Division of Applied Psychology, Carnegie 
Institute of Technology, Pittsburgh, Pa. 



The clerical examination here reported has been taken by 
about five thousand office cleiics and has been standardized 
by the Phoenix Mutual Life Insurance Co., the Equitable Life 
Assurance Society, the Westinghouse Electric & Mfg. Co., the 
Bell Telephone Co., Western Electric Co., Strawbridge & 
Clothier, Armstrong Cork Co., and others. 

In devising a vocational test the psychologist should be 
guided by three fundamental considerations affecting the con- 
tent of the test. 1 ) The difficulty of the content should cor- 
respond to the intelligence level of acceptable candidates. 2) 
The content should have an interest appeal to candidates who 
would be interested in the work tested for. 3) The special 
abilities should be represented in the test if there are any 
demonstrable special abilities. I do not believe that office 
work has any special abilities that have so far been demon- 
strated and hence I have confined myself to the first two 
criteria; namely, an appropriate intelligence level and content 
that appeals to the applicant for an office position. This reduces 
itself to the same type of problem that we find so frequently 
in preparing vocational tests; namely, the preparation of an 
intelligence test out of relevant content. 

In deciding on the length of a vocational test we may be 
guided by two diametrically opposed considerations. If we 
have in mind the convenience of the interviewer or examiner 
in the employment office we should be tempted to use a short 
ten-minute test. So many distracting influences may appear 
in ten minutes and so much depends on the candidates " warm- 
ing up " to the test that I should hesitate rejecting an appli- 
cant on what he does in a ten-minute interval. However, a 
ten-minute test is diagnostically more valuable than a ten- 
minute interview and if the two are combined, so much the 
better. The opposite consideration is that if no test is given, 
the applicant is put to work imder more or less informal 
observation, and if the supervision is at all adequate it will 
appear during the course of a week or two whether the new 
employee is unusually capable. But two or three weeks repre- 
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sent many hours, not minutes. Now, why should we not give 
the employee a standardized sample office job which requires 
about 45 to 60 minutes? By means of a sample office job 
which has been standardized we may know more about the can- 
didate's capacity for a variety of office jobs than can possibly 
be judged from a short list of opposites or other brief general 
intelligence test. These are some of the assumptions on which 
the clerical examination was devised. ^ 

The following is a brief description of the eight parts of 
the examination. 

A. In this part the candidate checks the errors in addition 
and subtraction. There are only a few errors on the page of 
120 additions. The small number of errors is intended to 
duplicate actual office conditions in which errors are even at 
worst more infrequent than correct answers. The careless 
candidate sees so many of the additions correctly performed 
that he does not scrutinize each item sufficiently to discover 
the errors. 

B. In this part the candidate reads a section of Arnold 
Bennett's " Mental Efficiency " in which about forty of the 
words are incorrectly spelled. He is instructed to underscore 
every word that is incorrectly spelled, but the careless candi- 
date becomes interested in the content and forgets to look for 
spelling, a condition which is t3rpical in jnany office situations. 

C. In this part of the examination the candidate cancels the 
four letters X, Z, U, and C. This combination of letters is 
rather difficult to keep in mind and taxes the attention of the 
candidate. 

D. This is a short code learning test in which the syste- 
matic worker can profit from attending to the task in hand and 
thereby soon learning the letter-digit combinations. By doing 
so he gains time. 

E. This is an alphabetizing test in which the candidate 
writes a list of forty names, placing each name in one of ten 
spaces and alphabetizing each of the ten groups of names. 
This test shows not only handwriting but affords a good op- 
porttmity for systematizing a simple clerical job since the 
candidate can choose among many different methods of doing 
the task. 

F. This is also a test in which the candidate can profit by 
planning the task. He is expected to designate a list of in- 
surance policies in three classes, according to the kind of 
policy, the date of issue, and the amount. He must keep these 
three attributes of the policies in mind simultaneously or so 
arrange his task that he can deal with each attribute sepa- 
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rately. The method of performing the classification is neces- 
sarily chosen by the applicant. 

G. The Clerical Examination would not be complete with- 
out an arithmetic test. This part of the test contains twelve 
simple problems in arithmetic, including addition, subtraction, 
multiplication, fractions, and percentage. 

H. The last part of the Clerical Examination is a bona fide 
general intelligence test and consists in matching ten prov- 
erbs with ten other proverbs so that the two proverbs in each 
pair have the same meaning or moral. 

The Clerical Examination is given as an omnibus test with 
a maximum time limit of 90 minutes for the whole pamphlet. 
The average time is approximately 40 minutes. The instruc- 
tions to the examiner are as follows : 

" Give the applicant a copy of the Clerical Examination and 
ask him to do what it tells him to do. Select for him a quiet 
table where he may work without being disturbed. Record 
on the cover of the applicant's paper the * Starting Time.' 
Tell him to return the blank to you or your assistant when 
he has finished. When the applicant returns the papers, record 
his * Finishing Time.' " 

I have found it convenient to eliminate the test proper from 
the first page of mental test blanks. The test proper is begun 
after the candidate turns the title page. This feature gives 
the examiner better control over the time, which is especially 
important with tests of short duration. On the title page of 
the Clerical Examination I have arranged a boxed space for 
a complete record of performance so that the examiner has a 
definite square in which to record each of the various scores, 
times, and percentiles. The headings in the boxed space are 
Finishing Time, Starting Time, Total Time, Speed Rank, 
Test A, Test B, Test C, Test D, Test E, Test F, Test G, Test 
H, Accuracy Score, Accuracy Rank, and Combined Rank. 

When these pamphlets are filed with the employee's per- 
sonnel records his performance in the Clerical Examination 
are easily referred to since it is summarized on the title page. 
The Accuracy Score is the sum of the scores allotted to each 
of the ten tests. The Accuracy Rank is the percentile rank 
of the Accuracy Score. The Speed Rank is the percentile 
rank of the Total Time. 

Statistical Evaluation 

In order to ascertain the diagnostic value of the examination 

it was gfiven to one hundred employees of a large insurance 

company ranging from minor executives to young office clerks 

doing routine work. The employees were rated in five classes 
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according to the grade of office work in which they are em- 
ployed. In addition to this information the age and schooling 
of each candidate was ascertained for correlation purposes. 
The following results are quite interesting. 

Grade of office work actually being done by the candidate 
correlates with: 

Accuracy in test r +.50 

Speed in test r +.42 

Schooling r +.47 

Age r +.35 

By multiple correlation the following coefficients have been 
ascertained between the grade of office work being done by 
the candidate and: 

Accuracy and Speed combined r +.61 

Schooling and Age combined r +.52 

Accuracy, Speed, Schooling r +.64 

Accuracy, Speed, Schooling, Age r +.67 

It is significant, as shown by these correlation coefficients, 
that speed and accuracy in the Clerical Examination give a 
more reliable prediction of ability in office work than age and 
schooling combined. 

In evaluating speed and accuracy by the method of multiple 
correlation it so happens that the two regression coefficients 
are alike, which means that in the combined score each minute 
of time is equal in weight to one of the 100 points of accuracy. 
This fortunate coincidence facilitates the determination of a 
combined score which represents both speed and accuracy. 

Owing to the extensive use of the test it is not advisable to 
publish the detailed test which would make it available for 
candidates who might be scheduled to take the examination. 
Therefore, I have been content to describe the nature of the 
test and especially the statistical findings. However, I shall 
gladly send samples of the test to psychologists and other 
responsible parties who are interested in the investigation. 
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By J. Crosby Chapman, Western Reserve University 

Object of the Study 

The adequate study of improvement in mental functions 
which concern the educational process must satisfy the follow- 
ing three requirements : ( 1 ) the measurement must involve a 
group of pupils of reasonable size; (2) the study must extend 
over a prolonged period of time; (3) the investigation must, 
as far as possible, be incidental to the school work. The 
measurement of a group is essential if safe general laws are 
to result ; extended practice is necessary because the curve of 
learning is by no means linear ; practise should be under school 
conditions, otherwise the norms of performance cannot be 
applied to ordinary school work. Fortunately such a study is 
possible ; typewriting as taught in the various business schools 
and high schools of commerce furnishes conditions, which 
while in no way equal to the exactness of laboratory experi- 
ments are yet sufficiently under control to be serviceable. 
Experiments on large groups found in such schools, working 
for long periods under normal circumstances, satisfy the con- 
ditions that have been laid down and give evidence concerning 
the general nature of changes in the rate of improvement in 
this complex function. ^ 

The present research was undertaken with a double object: 
( 1 ) to obtain evidence with a view to a systematic study of the 
psychology of skill from the objective standpoint. (2) To 
investigate the rate of improvement of the subjects, in this par- 
ticular school, using this particular method of instruction, in 
order to establish norms for the comparison of the relative 
values of different methods of instruction. The latter investi- 
gation has interest from th : administrative standpoint ; in the 
commercial schools of the country, various methods are em- 
ployed and it is a matter of some importance to see which 
method yields the most satisfactory results. 

Method of the Study 
The general method of the research was to test, each week 
in the school year, the speed of a mixed class, ages 16-18, in 
typewriting. The object of the weekly test was explained, 
each pupil being given a copy of the following : 
Information concerning the weekly test. 
The object of these tests, which will be given once a week, 
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is to measure the improvement of each pupil, and the improve- 
ment of the school, in speed of typewriting. Each week you 
will be given a five minute test, consisting of fresh material 
which is unknown to you. Your object is to type as much of 
this material as you can in the five minute period, remembering 
that errors count against you, to the extent of one word off for 
each error. If you wish to get the maximum score, you will 
have to decide, as you would in a game, whether it pays you 
to go quickly and make mistakes, or whether it pays to go 
slowly and not make mistakes. You alone can decide this. 
Your record will be carefully filed for reference and will form 
a picture of your improvement. We need not do more than 
ask for your hearty cooperation in this experiment, you wilb 
be working for your own reputation, and what is more im- 
portant, for the reputation of the school. 

The material used consisted of extracts from Addison's 
" Essays," which were selected so as to be of approximately 
equal difficulty. The samples were as a rule slightly modified 
by omissions and insertions. This was necessary to avoid 
foreign terms, unfamiliar words, long and intricate quotations, 
etc. By these modifications a greater degree of uniformity in 
the weekly extracts was obtained. A short sample is shown, 
the originals consisted, in all cases, of not less than 350 words. 

Sample. " The bridge, said he, is human life, look at it 
closely. Upon a more careful survey of it, I found that it 
consisted of seventy entire arches, with several broken arches 
which, added to those that were entire, made up the number 
about a himdred. As I was coimting the arches the spirit told 
me that this bridge consisted at first of a thousand arches, but 
that a great flood swept away the rest and left the bridge in 
the ruined condition in which I now saw it. But tell me fur- 
ther, said he, what you see on it. I see crowds of people 
passing over it, said I, and a black cloud hanging on each end 
of it ; as I looked more closely, I saw several of the passengers 
dropping through the bridge, into the great tide that flowed 
underneath it, and upon further examination, saw that there 
were many trap doors that lay concealed in the bridge." 

The extract was printed and on a certain day of the week 
the test was administered to the whole school. Care was taken 
that the various sections that took the test early in the day 
did not communicate with the later sections. The following 
report from each individual taking part in the test was ob- 
tained, in addition to the actual extract that was typed in the 
five minute period: 1. Hours practised since last test,* (a) in 

1 The hours reported included the time spent in receiving instruction, 
as well as the actual time at the keyboard. 
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school, (b) out of school; 2. gross number of words t3rped in 
five minutes; 3. number of errors in words, ptmctuation and 
spacing; 4. net score on the basis of one point for each word 
attempted, less one point for each error. Before the test 
started very careful inquiries were made to find out whether 
the subjects had had previous practice in typewriting, if so, 
for how long, and what method of learning had been used. 
The scores as recorded in this paper are worked out from the 
data furnished by report 4, that is upon the total number of 
words attempted less one word for each error: in no word 
was more than a single error counted. The experimental 
errors and individual fluctuations are too great to justify the 
reduction of the scores to so fine a measure as number of 
strokes; the time that would be involved in such reduction 
would yield no adequate return. 

At the begfinning of this investigation, each pupil in the 
school who was studying typewriting, whatever his previous 
amount of practice either in school or out of school, was given 
the weekly test. This was continued imtil the group which 
was the most elementary had completed about 180 hours of 
practice. Meanwhile the more advanced sections had grad- 
uated. In this way the complete curve of learning was ob- 
tained for only one group ; for the other groups merely a cross 
section of the curve resulted. The reason for the inclusion of 
all pupils was twofold, firstly it was hoped that the estimates 
of tfie previous amotmts of practice of the sections would be 
sufficiently accurate to justify the compounding of results and 
comparison of groups. Secondly, if peculiar results were 
obtained with the most elementary section, during any time in 
the practice period, it was thought that useful corroborating 
evidence would be furnished by the other groups. In this 
present report the results recorded were obtained from the 
elementary section of pupils who were first given the test when 
they had practised for a period of 20 hours. They were con- 
sistently measured at two to three hour intervals, until they 
had completed a period of 180 hours practice. The data from 
the other sections have not been used in this paper, partly be- 
cause there proved to be considerable doubt about the quantita- 
tive accuracy of the estimates of the periods of practice before 
the tests began, but largely owing to the fact that the results 
obtained from the group with 20 to 180 hours practice failed 
to reveal any peculiarity or anomaly which necessitated refer- 
ence to the results of the other sections. 
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Reason for selecting 20 hours as the period of minimum 
practice 

Dealing with the section that had just commenced type- 
writing, it was not feasible to measure improvement from 
the very early hours, for in the touch method, the attempt is 
first made to familiarize the learner with particular portions 
of the keyboard. Under these conditions the power of typing 
a continuous piece would be no test of improvement; in fact 
even after ten or fifteen hours there would be a decided 
tendency if the basis of scoring was one point off for each 
error to be zero or even negative. In the touch method, unless 
a certain point is passed, work of any reasonable kind is out 
of the question. This would not apply to learning by the sight 
method, where accuracy and steady improvement may be ex- 
pected. In the touch system certain elementary habit groups 
have to be formed before the individual can attain a positive 
score at all ; to this extent the scale is inadequate, for a zero 
score need not represent the zero of typewriting ability. How- 
ever, any other method of scoring, unless we reduce to strokes 
correct, would suffer from greater disadvantages than this 
present method. It is perhaps legfitimate to assume that an 
individual who on the average makes a mistake in each word, 
has, from the practical standpoint, something which ap- 
proaches zero ability in the trait. 

Final selection of subjects 

About thirty-five individuals formed the group on which the 
first measurement was made after twenty hours of practice. 
Due to withdrawal, elimination, uncontrolled practice out of 
school, and lengthy absences only twenty ^ of these thirty-five 
individuals were consistently tested for the hundred and eighty 
hours of the practice period. If we consider the begfinners in 
this section as a random sampling of the human material that 
commences the study of typewriting in commercial high 
schools, it is perhaps reasonable to suppose that the twenty 
individuals who completed the major part of the course form 
a slightly selected group. There are however certain coimter- 
balancing factors. In most cases the elimination due to in- 
efficiency, which is small, is not based primarily on lack of 
typewriting ability; in fact towards the end the withdrawals 
might well be those who, because of superior attainments in 

^As a matter of fact nineteen, for the record of subj^t P ends at 
no hours; this record was included by mistake, but it has been retained 
in order to avoid recalculation. 
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Stenography and shorthand, were commercially acceptable for 
early employment. The financial and social factors in the 
home — ^a large cause of the elimination — would be independent 
of typewriting ability. We may consider therefore, without 
making any appreciable error that the twenty pupils who com- 
pleted the major part of the course were not selected upon any 
basis which would cause the results to lose any material value. 
The conclusions may be taken as typicaA of the normal rates of 
improvement for students of high school age and attainments, 
who are taught under the conditions prevailing in this school. 

Tables and curves of improvement of the twenty subjects over 
period of practice from 20 — 180 hours 
In order that these results may be used for more general 
purposes than the specific objects of this present study, it 
seems advisable to give in their complete form the material on 
which is based the curves of improvement for each individual. 
This is found in Table I. No record of errors is reported in 
this study, the two measurements which define any weekly test 
record are: 1. the total number of hours of practice since 
the last test taken ; 2. the score on the basis of the number of 
words attempted in five minutes less the number of words in 
which errors were made, with one word subtracted for a 
spacing or punctuation error. If the reader is interested in 
the relationship between speed and accuracy a large number of 
typical results can be obtained from an earlier paper* which 
reported the positive acceleration in improvement which is 
found in many cases in the early part of the practice period. 
In this paper will be found a discussion of other studies which 
have investigated the learning curve in typewriting. For this 
reason any such discussion has been omitted from this paper. 

» Chapman & Hills. Journal of Experimental Psychology, Vol. I, 
No. 6, pp. 494-507. 
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From this table the curves of improvement of eight typical 
individuals have been drawn 
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Diagram 8 



Care must be used before making generalisations on the 
basis of one or two points which form part of any particular 
curve. Each point on the curve is the result obtained from one 
test period of five minutes. The score of this period is sub- 
ject to the fluctuation always found under such conditions, due 
to complex internal factors of interest, fatigue, interference, 
excitement, adaptation, etc. In addition any period which is 
represented by an erratic point may have been subject to the 
errors arising from 1. subject not stopping at signal given; 2. 
a copy which for some reason or another was much more difii- 
cult or much more straightforward for a particular subject 
than the average run of copy. This warning is given to pre- 
vent those who may work over these results from pressing any 
single values into the solution of problems, where the error 
of observation of the value may be too great. A combination 
of points however may be taken as a fairly reliable guide for 
such work. 

An analysis of the shapes of the curves reveals among other 
things the following facts : 

1. Individuals, reaching after the same period of practice 
the same degree of skill, do not by any means learn in the 
same manner; 

2. there is no f imdamental or typical curve to which all in- 
dividual curves approximate; 

3. short plateaus are present in the curve of many indi- 
viduals, these plateaus are probably genuine, but they do not 
occur at fixed places which are the same for all individuals; 

4. some individuals show distinct positive acceleration in 
improvement in the period from 20—60 hours ; 
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5. some subjects are comparatively erratic in their variations 
from week to week, due to a complexity of internal factors, 
while others seem to vary little from the rate of performance 
which their own curve of improvement indicates is the true 
rate. 

It is impossible within the compass of this paper to do more 
than mention these salient points, in a later paper the author 
hopes, if interesting facts result from the other material in 
his possession, to publish more evidence on some of these 
points. 

Distribution table showing the relation between amounts of 
practice and scores at specified intervals of time 

In the contingency table (table II), there are shown the 
scores made by the twenty subjects distributed according to 
the various practice periods. It should be noted that the 
twenty-five hour period includes twenty to twenty-nine hours 
of practice, while a score of twenty-five represents any value 
between twenty and twenty-nine. 

A slight explanation is needed with reference to the cases 
included under any particular practice period ; it does not fol- 
low that in each period the same individual will be included 
an equal number of times. Owing to practice out of school 
and to absences all of which were recorded, it may happen 
that whereas in the period 20-29 hours, A has five scores, dur- 
ing the period 30-39 A happened to have only four scores in- 
cluded. This factor however neutralizes itself and the aver- 
ages obtained are almost identical with those that would result 
if within each period an equal number of scores for each indi- 
vidual had happened to be present. 

Tables and curves showing scores at various intervals of 

practice 

On the basis of distribution Table (II) the following scores 
for each ten hours of practice are shown in Table III. 

(1) Average of the two lowest scores, (2) the 25 per cent 
point (counting from lowest individual), (3) median score, 
(4) the 75 per cent point, (5) average of the two highest 
scores. This tabulated material is e^diibited graphically in 
diagram 9. In table (IV) the average score for each ten 
hours of practice is given, and the composite result shown in 
diagram 10. 

The three salient features of the curve of improvement (dia- 
gram 10) are: (1) The initial linear relationship which ex- 
tends over a period of 75 hours, (2) the abrupt turning point 
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at approximately 90 hours of practice, (3) the return to the 
second linear curve which extends from 90 hours to at least 
180 hours of practice. 

The main questions which arise from the abrupt turning 
point at approximately 90 hours are : 

(1) Is this characteristic of the particular method of teach- 
ing (the Curry method) ? 

(2) Is it perhaps only true of the work of this one school? 

(3) Is the school justified in spending the period from 90- 
180 hours for such small returns ? 

TABLE HI 
Table Showing Scokbs at Various Intbkvals Duking the Practicb Period 
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Average of two lo»e»t 
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TABLE IV 
AvBRAOB Scobs at Various Intbrvals of Practice 



Hoon practice. 
Score, five min- 
ute period — 



I 
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65 
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95 
216 
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Average Curve 



Only one point need be made ; as far as the writer can judge, 
there is nothing in the method used in this school, or change 
in type of instruction or aim of work, at ninety hours to sug- 
gest any such rapid alteration in the slope of learning curve. 
Most of the problems raised will only be settled by the publi- 
cation of studies on similar lines which investigate improve- 
ment in typewriting, where other methods of instruction are 
employed. 

While from the standpoint of diagnosis any equation of a 
curve with such an abrupt point of turning is worthless, for 
mere convenience the following equations are g^ven, which 
have practical value for reference but no tfieoretical 
significance. 

For period of practice, 20^ hours Y=2«1X 
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For period of practice, 90-180 hours Y=180+.4X 
Where X is expressed in hours and Y is the average number 
of words typed in five minutes with one word deducted for 
each error. The incidental uses which can be made of the 
detailed results given in the tables are numerous, these have 
been left for reasons of space and because of the particular 
interest of the writer. However the examination of a fairly 
large group in a complex mental function over 160 hours of 
practice has yielded objective results which show how dan- 
gerous may be the attempts to construct a psychology of skill 
based on the short period examination of the rates of improve- 
ment of one or two subjects. 

Forecasting of future skill in typewriting 
In view of the work, which is being done in vocational guid- 
.ance, which attempts to predict future ability in some specific 
occupation after training, it is interesting to analyze some of 
the results obtained in this paper. The question which is 
asked is : " To what extent is it possible from the initial suc- 
cess of an individual in typewriting to predict the degree of 
success after prolonged training?" To investigate this ques- 
tion the average score of each subject has been determined at 
three periods in the practice experiment. These periods are 
(a) 20-35 hours; (b) 76-91 hours; (c) 136-151 hours. The 
scores of each subject over each of these periods were aver- 
aged and they are shown together with the ranking in table V. 
The first period was chosen because it furnishes the first pos- 
sible moment at which it was fair to make comparisons for 
reasons given earlier in the paper. The second period (76-91 
hours) was selected because it falls before the point of diange 
in the curve, which appears to take place at 90 hours. The 
third period was selected because it gives us some approxima- 
tions to the final standing of the individual. 
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Average Scores of Each Individual at Three Points in the Practice Period 
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The following points should be noted: 1. No test was made 
until twenty hours of practice in the function; 2. The test 
itself was an average of three to five measurements over a 
period of sixteen hours; 3. The test was in identically the 
same function as that in which later skill was desired. 

The correlations between initial ability, intermediate ability, 
and final ability are shown below, using the method of rank 
square deviations: 

Initial ability with final ability 65 

Initial ability with intermediate ability 66 

Intermediate ability with final ability 66 



\ 



These coefficients are reasonably high from the statistical 
point of view; that is a school, wishing to choose fifty pupils 
from a hundred who had practised 20 hours, might well con- 
sult the records at the end of this period of time. But if jus- 
tice to the individual rather than a " statistical justice " to the 
group is necessary, it can readily be seen that the use of the 
initial ability as an indication of future skill would be very , 
precarious. It is more likely that a mental test of fifteen min- / 
utes would give a better selection for the purpose of even the / 
narrow function of typewriting and certainly for the whole ' 
work of the school. 

The ordinary skill prediction test, when used for the pur- 
pose of vocational guidance, takes but a few minutes to admin- 
ister, is often a matter of chance initial adaptation, and is 
usually in a very diflFerent function from that in which future 
skill is to be predicted. Tests of this type must be thoroughly 
tried out before their usefulness is admitted. For in contrast 
to the ordinary skill forecasting test, it must be remembered 
that the prediction test here described was a very lengthy one, 
after considerable adaptation, and in precisely the same func- 
tion as that in which prediction was to be made. The low 
assurance value from the standpoint of individual guidance is 
revealed by the correlation coefficients. Vocational tests are 
not usually given for purposes of group selection but primarily 
for purposes of individual guidance. Therefore the distinction 
between " statistical justice " and " individual justice " be- 
comes of great moment. Many who quote high correlation 
coefficients seem to forget this important consideration. To 
the man who is seriously wounded in action, the fact that he 
had a 99 per cent chance of safety is small comfort, but the 
same factor is a perfectly legitimate basis at headquarters for 
the calculation of replacements. The school must use every 
means in its power especially in the vital problem of vocational 
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guidance, to guard the rights of the individual while it adopts 
the necessary selections which are based on statistical averages. 

Sumtnary 

The learning curve in typewriting has been studied over a 
period of practice extending from 20 to 180 hours. From a 
large amount of data, twenty full individual records have been 
selected for presentation. The following are some of the more 
salient results: 1. There is no fundamental typical curve of 
improvement ; 2. prolonged plateaus are notably absent,* most 
of the subjects exhibit short plateaus which are probably 
genuine; 3. some subjects show positive acceleration in im- 
provement in the period 20 to 60 hours; 4. subjects vary 
greatly in their erratic variations from week to week. 

The norms of achievement at each ten hour period are given 
in six forms : a. the lowest point ; b. the lower quartile point ; 
c. median point ; d average point ; e. upper quartile point ; the 
highest point. 

The composite curve of improvement shows a most abrupt 
change of direction at 90 hours, from having an initial equa- 
tion, (Y=2.3X) to a form, (Y=180+.4X). 

The early results have been analyzed from the standpoint 
of their value in the prediction of future typewriting skill. 

This study, which involved careful work each week for 
nearly two years, could never have been carried out without 
the continuous help of Mr. James S. Curry. Mr. Curry is the 
inventor of the method of instruction in typewriting which 
goes by his name. The subjects of this study were therefore 
under the supervision of the originator of the method. In 
expressing my obligation, I wish to join with the name of Mr. 
Curry that of Miss M. E. Hills, with whom this work was 
jointly started but whose absence from the city prevented its 
joint completion. 

^Unless, as evidence seems to suggest, the period, from 95 — 180 
hours, is considered as a long plateau, from which the subject, with 
great effort, can rise. 
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NATIONAL CONFERENCE ON AMERICANIZATION 
IN INDUSTRIES^ 



By Chester S. Carney 



Introduction 

About 200 persons assembled at the Atlantic Hotel, Nan- 
tasket Beach, Mass., June 23 and 24, to discuss the part which 
industry should take in the program of Americanization. 

This meeting was an outgrowth of the Conference of Ameri- 
canization Workers held in Washington in May under the 
auspices of the United States Department of the Interior. 
About three-quarters of the delegates represented industrial 
establishments either directly or through associations like the 
Associated Industries of Massachusetts and the National Man- 
ufacturers Association. The remainder came from such or- 
ganizations as the Y. M. C. A., City and State Boards of 
Education, City Americanization Committees, and War Camp 
Community Service organizations. 

This was a most happy combination of seers and doers, 
resulting in a series of inspirational addresses on what Ameri- 
canization should accomplish, supplemented by suggestive dis- 
cussions on the practical details of " how to do it." 

What Is Americanization? 
The ke)mote of the conference was the emphatic assertion 
that Americanization is a community activity, more organic 
than mechanical in its nature, that it means more than mere 
naturalization of foreigners. It is even bigger than an edu- 
cational program of instruction in English, history, and civil 
government. It means the assimilation of our foreign bom 
population into all phases of our national life, involving a 
change in the attitude on the part of the native American, as 
well as a development of the ideals of the foreigner. " You 
cannot become an American overnight, by an initiation pro- 
ess, the way you become a Mason or an Elk." ** It is not like 

^ This report is reproduced here by kind permission of Scovdl, 
Wellington & Company, Boston, New York, Chicago, Qeveland and 
Springfield, Mass., Industrial Engineers and Scientific Management 
with whom the author is associated. 
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changing a suit of clothes." " We must be more concerned 
with the quality of citizenship rather than with the quantity." 
It was repeatedly pointed out that each racial group has its 
contribution to make toward our mutual welfare; that we 
have much to learn from the " stranger within our gates ; " 
that no line can be drawn between Americans and immigrants : 
we are all immigrants originally ; and that we must never allow 
ourselves to indulge in the " I-am-hoHer-than-thou " attitude 
of raising the foreigner up to our level, but rather that we 
have a great destiny to work out which we cannot accomplish 
without his help. We want to work with him, not for him, 
realizing that he is an asset, not a liability. 

Should Attendance at English Classes Be Compulsory? 

The problem of how to retain class attendance drew the 
fire from all the batteries. Representatives of several large 
plants argued at some length for compulsion. The analogy 
of compulsory attendance at public school was drawn. It was 
asserted that some workers did not know what was good for 
them, and that those who would not attend English classes 
were undesirable employees. " The voluntary attendance plan 
had been tried, and had failed. Attendance started at 200 and 
dropped to 20." 

Opposing the benevolent patemalists were the champions of 
democracy, proclaiming the essential sanity and good inten- 
tions of the majority of mankind; that it was rare, when the 
matter had been properly presented to the men, that anyone 
refused to attend class ; and that the few unwilling individuals 
would finally yield to the pressure of public opinion without 
necessitating the use of the big stick. This argument pre- 
vailed to such an extent that a vote of 100 to 8 was taken in 
favor of voluntary attendance. That this was not wholly 
indicative of the sentiment of the entire conference was evi- 
dent in the open forum Tuesday afternoon, when the com- 
pulsionists were reinforced by late arrivals and the democrats 
were weakened by the loss of their leading orator. But a vote 
was not taken, and the majority still seemed opposed to com- 
pulsion. During the discussion a very able mediator distin- 
guished clearly between the men who are successful because 
of their powerful personality, in spite of the fact that the the- 
ories they hold are false, and men whose theories may be fine 
but who fail to "get them across." 
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Should Employees Be Paid for Time Spent in Class 
Attendance? 

Few arguments were raised on either side of the question. 
Most seemed to agree that when classes were held during 
working hours the hourly rate should be paid, and when 
classes were held after working hours no payment should be 
made. A census of the delegates showed 18 plants holding 
classes during working hours, 36 plants holding classes after 
working hours, and 6 dividing the class period between em- 
ployee's and employer's time. Three plants actually charged 
an enrollment fee, which in two cases was returnable at the 
end of the course. 

What Relation Should Exist Between the Teachers of 
English to Non-English Speaking Workers and the 
Public School Authorities? 

One of the two most discussed issues raised at the conven- 
tion was the extent to whidi the work of teaching English to 
non-English speaking workers should be turned over to the 
public school authorities. 

On the one side were those who had in mind the general 
principle that teaching was the function of the public schools, 
and production the function of industry; that therefore all 
educational work should be headed up and supervised by the 
public school authorities. 

On the opposite side were those who had found particular 
iftstances where the public schools had not lived up to their 
civic obligation, so that the work would have been neglected 
had not philanthropic or industrial organizations come to the 
rescue. 

Between these two camps there was no essential disagree- 
ment. It was practically the unanimous opinion that coopera- 
tion with the public schools was desirable. All admitted that 
in some communities the public school had not been ready to 
assume the responsibility, and sometimes had failed to accom- 
plish the work it had undertaken. But the faults, it was ar- 
gued, were faults of a locality, and not of a principle. As 
one opportunist put it: "We all know that *the cathedrals 
are built of the stones of the country,' that conditions in one 
locality make one plan a success, while the same plan would 
fail utterly under the conditions which obtain in another 
locality. But we must agree that as a general rule, super- 
vision by the public school is desirable." 
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Practical Hints On How To Do It 

In the discussion of practical details some valuable sugges- 
tions were brought out. 

From several sources came descriptions of graduation exer- 
cises which help the new citizen to realize the significance of 
his enfranchisement ; that his " Second Papers " are in a dif- 
ferent class from his vaccination certificate, with which they 
were frequently confused by applicants for war work in a 
certain plant ! In one place the graduates were addressed by 
the Mayor, the Governor, and a representative of the Fedentl 
Government, after which they were personally introduced to 
these officials. 

In another a pageant was held, where the " Goddess " of 
the city welcomed each racial group into her family expressing 
her appreciation of the gifts which each group contributed, 
and maidens in folk costumes responded, laying at her feet 
symbols of these gifts. 

The necessity of reaching the foreigner in his own language 
was often stated. One of the most practical papers, by a man 
who has organized Americanization work in several plants, 
presented the following program: 

1. General propaganda — ^through foreign-language pa- 
pers, pay-envelope stuflFers, bulletins and pamphlets de- 
scribing the plan in detail printed in the native languages 
of the foreigners. 

2. Group mass meetings, addressed by interpreters who 
are prominent in the national group. 

3. Personal interview by a representative of the man- 
agement, a high grade man who will explain that the aim 
is to help the worker to find his way through the diffi- 
culties of red tape attached to the process of naturaliza- 
tion. 

4. Training for citizenship. The laboratory, or "di- 
rect" method was advocated; the first seven of ten les- 
sons to be devoted to what the government does for the 
individual, the last three on what the individual does for 
the government. The teacher must know the difficulties 
which confront the applicant for citizenship, especially 
the court procedure. One teacher conducts a mock-court 
as a final lesson of the course, showing just what is to be 
expected. 

5. Arrange for filing papers in court. The foreman is 
a better witness than the saloon keeper. 

6. Welcome to citizenship should be a social event in 
which plant and civic officials should participate. 



Digitized by 



Google 



CONFERENCE ON AMERICANIZATION IN INDUSTRIES 273 

In teaching English, four grades are useful: 

I. Illiterates in their native language. 

II. Those who cannot speak English, but can read and 
write another language. 

III. Those who speak English, but can read and write 
it very little. 

IV. Those who can read and write English. These 
are ready for citizenship course. 

One speaker pointed out that instruction in English was the 
first step in safety work. 

Another stated that classes in English were held for con- 
valescents in the hospital where the work helped to fill their 
idle time. 

In one plant where the company was conducting classes 
twice a week during working hours the students of their own 
accord requested a third session to be held on their own time. 

A large rubber company held " Recognition " exercises Sun- 
day afternoon, which 1,200 people attended, and at which 400 
students received diplomas in recognition of 75 or 150 hours' 
attendance at classes. 

In addition to the class work, all recreation activities and 
the work of the visiting nurse were declared to be valuable 
points of contact by which Americanization can be forwarded. 

There was repeated emphasis upon the importance of the 
foreman's active cooperation in all eflForts for Americaniza- 
tion, particularly in following up absentees. 

One plant has accomplished fine work in cooperation with 
the International Institute of the Y. W. C. A. Rooms were 
rented in the district where the foreigners lived, and classes 
were conducted in English and domestic science for the wives 
and children of the workers. 

In another plant dances are held frequently, with folk 
dances taught by foreigners and American dances by the 
native bom. 

An interesting suggestion was that of modifying the S% 
alien income tax to apply to all who have not taken out first 
papers, and 4% to all who are not citizens, the proceeds to 
be used for Americanization work. 

A representative of the State Board of Education outlined 
a plan by which instructors were to be chosen from within the 
works, and trained to teach English to adult immigrants in a 
class conducted by the board of education. He pointed out 
the advantage of such teachers to the plant in promoting 
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esprit de corps, and asserted that teaching English to adult 
foreigners was a special problem in itself. 

One speaker asserted that Bolshevism was a product cre- 
ated in New York by our failure properly to Americanize our 
immigrants. 

Addresses On Other Subjects 

In addition to the discussions of Americanization, several 
worth-while addresses were made by men who have been 
doing conspicuous work during the war. Mr. Howard Coon- 
ley, president of the Walworth Company and formerly vice- 
president of the Emergency Fleet Corporation, told of their 
experiences in handling disagreements between management 
and men, which were settled in conferences between seven 
representatives of the men and seven representatives of the 
management. 

He expects great volume of business this fall, with accom- 
panying shortage of labor. 

Mr. W. Graydon Stetson spoke on the program for thrift 
and saving, which will probably be continued for at least five 
years more, he believes. 

Mr. B. Preston Clark, of the Plymouth Cordage Co., spoke 
most interestingly of the two great movements resulting from 
the war : the increasing power of the people, and the increas- 
ing value of leadership. He quoted the Arabian proverb, — 
"The camel-driver has his thoughts, and so has the camel, 
too," and asserted that we need more than ever before to 
consider the thoughts of the "camel." The futility of the- 
orizing without intimate sympathetic knowledge of the con- 
ditions he illustrated by quoting: 

"The toad beneath the harrow knows 
Exactly where each tooth-print goes. 
The butterfly flitting by the road 
Preaches contentment to the toad." 

He is hopeful of an ultimate solution of the Americaniza- 
tion problem, because this conference has shown very clearly 
that we possess the two essential qualities — imagination and 
humanity. 

Mr. Frederic C. Hood, president of the Associated Indus- 
tries of Massachusetts, in his opening address declared that 
management has two branches, one the management of mate- 
rials — which is applied science — and the other the manage- 
ment of men — which is applied religion. He called attention 
to the need of a higher grade of leadership, and asked whether 
managers were prepared to supply this leadership, or must 
the workers look elsewhere. He asserted that 75% of the 
cases which came before the War Labor Board came from 
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industries suffering under absentee management. He empha- 
sized the strategic importance of the teacher in the Ameri- 
canization program, and advocated the payment of better 
salaries. He urged all to read: 

" Back to the Republic" Harry F. Atwood (Laird 
& Lee). 

''Money and Prices,'* J. Lawrence Laughlin (Chas. 
Scribners Sons). 

An able paper written by Mr. Alvan McCauley, president 
of the Packard Motor Company (who could not be present), 
pointed out the need for greater coordination and cooperation 
among the various bureaus of government and the volunteer 
organizations concerned with Ainericanization. He declared 
that " there is a confusion of tongues " and much working at 
cross purposes. 

Appendix A 
Resolutions Adopted by the Conference 

" We, the representatives of the educational forces of in- 
dustry, recognize that industry has a definite part with the 
other forces of the community in initiating and organizing 
Americanization work; therefore, 

"Resolved, That instruction in English for non-English 
speaking people should be carried on in cooperation with the 
public educational forces, provided such forces are prepared 
and will assume responsibility. We pledge our aid in our 
respective communities to bring about this cooperation. 

" Resolved, That non-English speaking employees attending 
English classes in industry should attend such classes volun- 
tarily and without compensation. 

'Resolved, That every industry employing non-English 
speaking people formulate a definite policy regarding Ameri- 
canization work, and that such work can best be done when a 
responsible person is charged with its direction. 

"Resolved, That we, as a representative group of indus- 
tries, unanimously disapprove making naturalization a con- 
dition of emplo)rment, and recommend that every community 
establish at least one school for citizenship.'' 

Appendix B 
List of Pamphlets on Americanization 
A number of pamphlets were exhibited, which would be 
suggestive to any plant planning to install classes in English 
or citizenship. Such a plant will receive help from the or- 
ganizations referred to below. 

City History Club of New York, IDS West 40th Street, 
N. Y., have a program using the laboratory method. 
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Associated Industries of Massachusetts, 1034 KimbaU 
BIdg., Boston Mass. "Americanization in Industry — 
How to Organize English and Citizenship Classes," by 
George F. Quimby. 31 pp. 

Americanization Bureau, Pennsylvania Council of Na- 
tional Defense. George W. Pepper, chairman, Phila- 
delphia. "Americanization in Pennsylvania." 40 pp. 

Americanization Committee, City of Duluth, Minnesota. 
"How to Become an American." 24 pp. 15 cents. 
(Printed also in Italian.) 

Y. M. C. A., Lawrence, Mass. "The Citizen: First 
Lessons in United States History for Immigrant Men." 
31 pp. 25 cents. 

Charles H. Paull, Harvard University, Cambridge, Mass. 
" Americanization : A discussion of present conditions, 
with recommendations for the teaching of Non-Ameri- 
cans." (A report submitted to the Solvay Process 
Company.) 2/ pp. 

Federal Board of Vocational Education. "Advanced 
Course in English for Foreign-bom Men." 31 pp. 
1919. 

Raymond F. Crist, Deputy Commissioner of Naturaliza- 
tion, Washington, D. C. " Students' Textbook : Stand- 
ard Course of Instruction for the Preparation of the 
Candidate for the Responsibilities of Citizenship." 
132 pp. 1918. 

Department of University Extension, Massachusetts State 
Board of Education. " Federal-State Program for Im- 
migrant Education." 20 pp. January, 1919. " Eng- 
lish for American Citizenship." 12 pp. July, 1918. 

Old Colony Trust Company, 17 Court Street, Boston, 
Mass. " Getting Together," Extracts from addresses 
on Bolshevism, by A. J. Peters, N. B. Endicott, and 
W. H. Taft, May 20, 1919. 18 pp. 

Qeveland Board of Education. " Lessons in American 
Citizenship." Raymond Moley. 65 pp. 1918. 

Edwin A. Rumbull, General Secretary Civic Education 
Association, Buffalo, N. Y. " New Citizens' Hand- 
book." 34 pp. (Printed in Polish, Italian, Hungarian, 
etc.) 

International Committee of Y. M, C. A. has prepared 
extensive course in English for foreigners. 

The General Electric Company has prepared moving- 
picture film on Americanization, which may be bor- 
rowed by those interested, on application to Mr. M. R. 
Griffeth, 84 State Street, Boston. 
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MINOR STUDIES FROM THE PSYCHOLOGICAL 
LABORATORY OF INDIANA UNIVERSITY 

I. A COMPARISON OF COLORED AND WHITE CHILDREN 
BY MEANS OF A GROUP SCALE OF INTELLIGENCE. 



By S. L. Pressey and G. F. Tetbr. 



I. Problem and Materials, Colored children show a greater 
school retardation, less acceleration, and average older for a 
given grade, than do white children.^ There is some evidence 
to show that, grade for grade, they do poorer school work.* 
Negro children give ratings, when tested by the Binet and 
Point Scales, averaging below white children.' Measurements 
of special abilities have shown the colored children to do rela- 
tively well in tests of the more simple processes (as cancella- 
tion, rote memory) and most poorly with tests of the more 
complex abilities* (as opposites, analogies, sentence comple- 
tion). There is some evidence that colored children have 
more active imaginations and more ready associations of an 
uncontrolled type than do white children. 

There would thus appear to be the beginnings of an exact 
science of racial differences, as shown by school children. 
But — as has been well pointed out recently" — ^the proper evalu- 

* Sec for instance, Perring, L. F. A Study of Comparative Retarda- 
tion, Psychological Clinic, Vol. 9, 191 5, pp. 87-93; Mayo, M. J. The 
Mental Capacity of the American Negro, Archives of Psychology, 
No. 28, 1913. 

^ See for example, Mayo, as above. 

» Strong, A. C, Three Hundred Fifty White and Colored Children 
Measured by the Binet Simon Measuring Scale of Intelligence, Ped, 
Sem, Vol. 20, 1913, pp. 485-515; Phillips, B. A., The Binet Tests Applied 
to Colored Children, chiefly Kaffirs, Tr, Sch, Bull, Vol 12, 1915, pp. 
122-3; Redfem, L. H. and Rich, S. G., Binet Tests on South African 
Natives — ^Zulus, Ped, Sem, Vol. 24, 1917, pp. 373-83; Stmne, Dagny, 
A Comparative Study of White and Negro Children, /. of AppL 
Psychol, Vol. I. 1917, pp. 71-83. 

* See especially Pyle, W. H., The Mind of the Negro Child, School 
and Society, Vol. i, 1915, pp. 357-^; Ferguson, G. C. Jr., The Psy- 
chology of the Negro; An l^rperimental Study, Archives of Psy- 
chology. No. 36, 191 6, pp. 138; and Stmne, Strong, Red fern above; 
also Woodworth, R. S., Comparative Psychology of Races, Psychol, 
Bulletin, Vol. 13, 1916, pp. 388-96; and Thomdike, E. L., Educational 
Psychology, Vol. Ill, pp. 206-24, 1914. 

" Some Suggestions Relative to a Study of tiie Mental Attitude of 
the Negro, Ped, Sem, Vol. 23, 1916, pp. 199-204. 
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ation of such data is not easy. The vinsatisfactory school 
work of colored children may be, in part at least, merely an 
indication of lack of adaptation of the schools to their special 
needs. It may surely be questioned whether tests given by 
white examiners to colored pupils can give reliable data for 
a comparison of the races. There may even be some doubt 
as to whether, with examiners of their own race, the reaction 
of the colored children to the test situation would be quite 
the reaction of white children. In any case, the fact must 
not be forgotten that the colored children come from a social 
and psychological environment which is subtly but power- 
fully different from the environment which molds the men- 
talities of the white children; standards of living, moral and 
religious ideas, sentiments and interests and ideals, are all per- 
vasively different. It should be said at once that in the pres- 
ent instance the tests were given by white examiners, to 
colored children in schools showing no attempt at adaptation 
to the particular needs of the race, and in communities where 
there is sufficient race consciousness for the colored people 
to be a distinct class by themselves. But certain of the dif- 
ferences found seem too marked to be explainable as the 
result of such factors alone. There is, further, a sufficient 
variety of material available with regard to the subjects stud- 
ied to make possible some little analysis of the situation. 

The material consists of measurements, with a group scale 
of intelligence recently developed at Indiana University,' from 
all the children from the third through the twelfth grades in 
two schools for colored children in two small Indiana cities — 
a total of 187 cases in all — together with a study of the age- . 
grade placement of these children. The examining was done 
by the senior writer and his wife. The scale used may be 
briefly described as consisting of ten tests, each of twenty 
items, each test being applicable roughly from the third grade 
through high school or from 8 to 16 years in age. The indi- 
vidual tests will be described briefly, later, in connection with 
an analysis by test. 

The paper will take up in turn the following questions: 
(1) Grade for grade, how do the colored children compare 
with the white children? Do the colored schools have their 
own standards as to the amount of innate ability necessary 
for work in a given grade? In studying this question the 
colored schools will be compared with the grade distributions 
from one of these two cities (City A) — ^a total of 1,022 cases. 

« Presscy, S. L. and L. W., A Group Point Scale for Measuring 
General Intelligence, With First Results from i,ioo School Children, 
/r. of AppL Psychol Vol. II, 1918, pp. 250-269. 
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(2) Age for age, how do the colored children compare with 
white children? The scores made by the negro children will 
be compared with results from a total of 2,8(X) white children 
tested in these two cities and one other city (Cities A, B, and 
C). (3) Do the colored children show a distinctive make-up 
of abilities? In studying this question the results on the 
separate tests of the scale will be compared with norms for 
each test obtained from the white children of City A. 

II. Results. The composition of the grades in the colored 
schools may be briefly indicated. The number of children 
tested in eacb grade was as follows : 

Grade 3 4 5 6 7 8 9 10 11 12 ToUl 

Number 31 36 49 28 14 s 7 4 12 i 187 

The figures suggest a banking up of cases in the first three 
of these grades, and a high retardation. The colored schools 
showed, in fact, a total retardation 90% greater than the re- 
tardation for the white children of City A, and an accelera- 
tion less than half as great. The colored children also aver- 
aged ten months older per grade. If we turn now to the 
scores made by these children on the tests, we find that only 
36% of the colored children scored at or above the median 
for their ^ade in the white schools, 13% scored above the 
75 percentile, 51% below the 25 percentile. To put it another 
way, the colored children of a given grade average about at 
the average for the grade below theirs in the wWte schools. 
Apparently the colored schools require less intelligence, for 
a^nission to a given grade, than do the white schools. Grade 
for grade, the children in the colored schools average ten 
months older than the white children. Nevertheless, the grade 
averages are distinctly lower in the colored schools. 

But the fact that the colored schools distribute their children 
differently in the grades, as regards age, makes it impossible 
to obtain, from the grade averages, any satisfactory evidence 
as to the amount of difference between colored and white chil- 
dren in mental endowment. For such a purpose children of 
the same age should be compared. The number of cases 
tested at each age was as follows: 

Age 7 8 9 10 II 12 13 14 IS 16 17 Total 

Ntunber i 11 20 24 25 27 23 21 14 12 9 187 

After careful study of the age-grade distributions it was 
decided that the most reliable ages for comparison were ten, 
eleven, twelve, thirteen, and fourteen. Below ten there were 
too many cases who were in the first and second grades (and 
so not tested) to give a fair sampling; after fourteen the 
duller children drop out of school. Of 120 colored children 
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within these ages, only 14% score at or above the median for 
the white children of the corresponding age. Only 3% of 
the colored children score above the 75 percentiles of the 
white distribution. But 54% of the colored children score 
below the white 25 percentile. To put it another way, the 
colored children average at about the average for white chil- 
dren two years younger. 

When compared age for age, the colored children thus make 
a poorer showing than when compared grade for grade. Ap- 
parently the colored schools, having to deal with poorer mental 
material, have tried to keep up grade standards by retarding 
their children more — ^but have only partially succeeded. 

The scores of the colored children were next analyzed by 
test (using again, data from the five ages above menticMied). 
The per cents scoring at or above the medians for the white 
children, on each of the ten tests, are as follows : 

Test I 2 3 4 5 6 7 8 9x0 

Per cent 33 30 29 15 29 22 14 13 22 16 

The colored children do relatively well on the first, second, 
third, and fifth tests. The first is a test of rote memory ; the 
children are read such lists as " chalk, man, bag, book, sister," 
and then asked to write the word that came after "chalk." 
The fifth is a test of logical memory ; the children are read a 
newspaper passage and are then asked questions about it. 
The second is a test of practical judgment; the test consists 
of such lists as " CHAIR; — arm, cushion, legs, rockers, seat," 
and the children are told to " underline, in each list, the two 
things which the thing named in big letters at the beginning 
of the list is never without." The third is a test of practical 
arithmetic; the children are read such problems as "If you 
had 25 cents and bought two erasers at 3 cents each and a 
bottle of ink at 5 cents, how much would you have left? " 

The tests on which the colored children make the poorest 
showing are four of the five " literary " tests of the scale. 
Two of them involve controlled association, the fourth (Op- 
posites) and the tenth (Analogies) ; one of them requires a 
knowledge of moral terms and one calls for verbal ingenuity 
(number 8, Disarranged Sentences). The sixth test (Word 
Completiori — ^the test consists of such words as " a — it — ^me — 
ic " and the children are expected to fill in the missing letters) 
and the ninth test (Practical Information — the test contains 
such lists as " bill, coin, check, draft, stamps," and the children 
are asked to " put a line under the safest way to send money, 
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and a cross after the least safe way ") give results, with the 
colored children, midway between these extremes.^ 

III. Discussion, The above results are undoubtedly influ- 
enced by some of the prejudicial factors mentioned at the 
beginning of the paper. The examination was given by white 
examiners ; the tests were framed for use with white children. 
But certain of these differences between white children, and 
colored children living in the same community and taught 
under the same school system, are too marked to be wholly 
thus explained. A poor average ability seems unmistakably 
indicated — a poor ability inadequately compensated for in the 
schools by a greater retardation, and so leading to lower grade 
standards as well. 

It is natural, however, to seek an explanation for the lower 
scores in some special defect rather than in a general inca- 
pacity ; Piflrh rare might be supposed to have both weak and 
strong pbints. Analysis by test gives little support for such 
a theory; the colored children show poorer ability than the 
whites on every test. But there are distinct differences from 
test to test ; twice as many colored children make scores above 
the medians for the whites on the first, second, third, and fifth 
tests as pn the fourth, seventh, and eighth. The colored chil- 
dren do best in a test of rote memory. They do poorest in a 
test of verbal ingenuity and a test involving knowledge of 
abstract terms. It is easy to generalize, and conclude that 
colored children do best on tests pertaining to very concrete 
problems, or making demands upon the more simple mental 
processes. But such generalizations help us very little in 
getting at the real facts as to mental differences. It is more 
pertinent to note, in this connection, that the first test has been 
found poorest of the ten in differentiation of feebleminded and 
subnormal cases, the eighth most differential, and that the 
fifth and first are least differential of superior ability, the 
seventh and tenth the most differential. There is the definite 
suggestion here of a more elementary and less highly devel- 
oped ability among colored children. 

But one keeps coming back to the notion that the important 
racial difference may be, after all, emotional and tempera- 

T It should also be noted that the per cent passing each test above the 
white medians shows a fairly regular decline from the first to the last 
test; that is, there is a suggestion of a fatigue curve. One cannot help 
but wonder whether there is not evidence here of a greater fatigability 
on the part of the colored children. Fatigability is surely not the only 
factor at work; the last tests are also tests of the more complex pro- 
cesses. But this dropping off in scores toward the end of the examina- 
tion is distinctly interesting. 
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mental. Possible evidence of a greater fatigability on the 
part of the colored children has already been mentioned. The 
present study offers little material relative to such differences, 
but the writer is convinced that measures of such differences 
can be obtained. He feels strongly that the possibilities of 
group " tests " as instnmients for research have hardly yet 
been realized. Group tests for the measurement of persist- 
ence, of effort and interest, are, he believes, a likely develop- 
ment of the near future. 

IV. Summary. Measurements, obtained from the children 
in two colored schools with a group scale of intelligence, show 
that: 

1. The colored children of a given grade average at about 
the average for white children one grade below theirs. 

2. The colored children of a given age average at about the 
average for white children (in the same city) two years 
younger. 

3. Analysis by test shows the colored children to average 
below white children of the same age on all the tests. The 
colored children rate best on a test of rote memory, poorest 
on a test involving differentiation of abstract terms and a test 
of verbal ingenuity. It is suggested that in general colored 
children may do relatively well in dealing wiA concrete and 
routine problems, and poorly where abstraction or mental re- 
construction is called tor. 

4. Study of racial differences by means of group tests of 
persistence, and of interest, is suggested. 
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II. A STUDY OF COUNTRY CHILDREN IN (i) A GOOD AND 

(2) A POOR FARMING DISTRICT BY MEANS OF 

A GROUP SCALE OF INTELLIGENCE 



By S. L. Pkessey and J. B. Thomas. 



I. Materials and Problem. The materials of the study 
consist of results from 270 country school children tested by 
one of the writers (Dr. Pressey) and his wife in a poor rural 
district in southern Indiana, and 268 country school children 
in a fairly good agricultural district in the central part of the 
state, examined by a graduate student in Psychology (Mr. 
Thomas). The first group was examined in the spring of 
1918, the second in the fall of that year. The scale employed 
in the preceding study was used here; and comparisons are 
with the norms referred to there. 

The children examined were almost entirely of American 
stock. Special difficulties qualifying the findings, such as 
lan^age handicap, were thus not encountered. It should be 
said at once, however, that the data from the two country dis- 
tricts includes, besides children in the one room country 
schools, children in the schools of several small villages, tracl- 
ing centers for the country round about. In the first district 
there is also a small quarry town of perhaps 200 inhabitants, 
and in the second district a slightly larger mining town. Both 
quarry and mine obtain their labor largely from the country 
near, so the community centering around them can hardly be 
considered essentially different from the surrounding country. 
In fact, in this mingling of agriculture and small scale in- 
dustry, the districts may be said to be distinctly typical of 
southern Indiana. 

In working over the data three questions have been consid- 
ered. (1) Age for age, how do country children compare 
with city children? In studying this question the results from 
the two country districts have been combined and comparison 
made with results from the 2,800 city children, already men- 
tioned. (2) Do the country children show distinctive results 
on the separate tests? The comparison here is with norms 
for each test obtained from City A. (3) Is there any evi- 
dence to show that the less intelligent people live in the poorer 
country district? Comparison 1ms here been made of each 
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of the two covintry districts with the norms from three cities 
previously referred to. 

II. Results. The total number of country children at each 
age ran as follows : 

Age 8 9 10 II 12 13 14 15 16 Total 

No 17 59 86 81 78 76 49 39 18 503 

Because of the factors of grade selection mentioned in the 
preceding study, it was considered wise to use only ages 10-14 
inclusive in these comparisons. It soon appeared, however, 
that elimination in the country began earlier than in the city. 
This affected particularly the group examined in March, the 
older boys having already left school to help in the spring 
plowing. Only country children from ages 10-13 have there- 
fore been used in the comparisons. The per cents, at each of 
these ages, te sting at or above the median for city children of 
f the same age are as follows : * " 

f Age 10 II 12 13 

\^ Per cent 29% 33% 21% 25% 

/^ Of the total of 321 country children, of these four ages, 
/ 27% test above the age medians of the city children; 8% 
score above the 75 percentile; 42% rate below the 25 per- 
centiles. 

Again analysis by test is naturally looked to for aid in 
understanding these findings. In making this analysis the 
results from the same four ages have again been lumped, and 
the per cent of the country children scoring at or above the 
median for their age, on each test, has been found. 

Test I 2 3 4 5 6 7 8 9 10 

Per cent 38 35 39 26 40 29 25 33 33 31 

The most important feature seems to be the lack of such 
marked differences from test to test as were found in the 
similar analysis of the colored data. The colored children do 
almost three times as well on the first test as on the eighth. 
The poorest results shown by the country children are on test 
7 ; the best showing is 40% on test 5.^ The country children 
do not thus present a distinctive make-up of examination, but 
show a slightly poorer ability on all tests. 

It is not infrequently asserted that in the country districts a 
constant selective process is going on, the poorer, less intelli- 
gent stock being pushed back more and more into the hill 
country where the land is poorest, while the more able, as- 
sertive elements of the population obtain the best land and 
the best opportunities. That is, on this assumption, there 

^For a description of the separate tests see the previous study. 
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should, in an agricultural community, be a positive correlation 
between land values and intelligence. The two districts from 
which the data of the present study were obtained seem not 
ill suited to test this hypothesis. District 1 is hilly, the soil 
is poor ; markets are hard to get at. The land in District 2 is 
much better and markets are much nearer. It has been esti- 
mated roughly that the land in the second district is worth 
three times as much as that in the first. 

A comparison of the school children in the two districts by 
means of a mental test is thus distinctly interesting! For the 
four ages used above, 20% of the children in District 1 rate / 
above the medians for the city children as compared with 36% ^^ 
in District 2 — the better district; 6% in the poorer district 
score above the 75 percentile for the city children, as com- 
pared with 11% in the better district; 48% in the poorer dis- 
trict rate below the 25 percentile for the city children, as com- 
pared with 28% in the better district. 

These figures are probably not as reliable as one would wish. 
The schools in the poorer district were examined in March, 
which is close to the end of the year for the six months' 
schools. Already the children who could be of most assist- 
ance in the spring work on the farms had left school, in many 
instances. Because of this the figures from District 1 are 
possibly a little too low.^ As has already been said, the two 
districts were not examined by the same examiner. The ex^ 
aminations in District 2 were made by the least skilled exam- 
iner, and it is not improbable that the children in this district 
profited by his inexperience and his desire to be wholly fair 
to his children. But it is hard to entirely explain away the 
differences between these two districts by such special circum 
stances. At least, the results are of suggestive value, — are 
of decided interest in indicating ways in which results from a 
mental survey may be of use in the study of sociological 
problems. 

III. Discussion. A word remains to be said as to possible 
explanations of the lower scores made by the country children. 
The obvious conclusion would be that the country children 
were less intelligent. The writer feels that such an explana- 
tion is decidedly not wholly adequate. For one thing, country 
children do not meet the test situation in the easy matter-of- 
fact way usual with city children. They are distinctly shy 
with strangers, especially if they feel that the strangers come 
from the city; they adapt much less readily to the special 

^The country teachers usually say, however, that it is the duller 
children who thus leave school before the end of the term. 
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procedures and types of problem involved in the usual meas- 
urements of intelligence. That is, they show distinctly less 
"testability," though not necessarily less intelligence in meet- 
ing the problems of their own environment. 

Further, the tests used were all verbal ; they were presented 
on paper and involved the constant use of a pencil. The chil- 
dren were not as dextrous with their pencils as city children. 
In many instances, there were only two or three pencils in a 
school ; the written work was on the blackboard or on slates. 
Awkwardness, some embarrassment, and slow writing were 
the consequences. Moreover, verbal tests, such as were used, 
can hardly be expected to give a total measure of ability in a 
community where the work is almost wholly manual. Per- 
formance tests and, perhaps, a diflFerent mode of approach 
would seem necessary. It was urged in the preceding paper 
that the usual forms of intelligence tests are inadequate for 
the study of racial differences; it is urged again that these 
same tests need not a little supplementation in studying groups 
from very different environments. 

IV. Summary, 1. A group of unselected country children 
rate about a year and a half in mental age below city children. 

2. Analysis by test shows nothing that could be considered 
distinctive. 

3. The children in a good farming district average above 
children in a poor farming district. 

4. It is urged that the usual type of intelligence tests does 
not give adequate measures of the ability of country children ; 
performance tests and materials more relevant to their en- 
vironment are needed. 
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BOOK REVIEWS 

H. Addington Bruce. Nerve Control and How to Gain It, Funk A 
Wagnalls, New York and London, 1918. p. IX and 307. 

The purpose of this book, as stated by the author in the preface, is 
to aid primarily those persons who are suffering from nervous in- 
validism or feel themselves approaching it. Hope is also expressed 
that it will prove useful to normal individuals who wish to gain a pre- 
cise knowledge of the fundamentals of personal hygiene. 

With simple non-technical language Dr. Bruce presents in a clear 
wholesome manner the facts of mental hygiene that have been derived 
from the many medical, physiological and psychological researches 
carried on by the leading investigators in all parts of the world. As- 
suming that nervousness is not a disease in itself but rather a symptom 
of ill health which may have resulted from any one of many physical 
or mental causes, he proceeds to discuss these causes one by one in 
the form of little friendly talks. The topics include the effects of such 
bad habits as worry, fear, anger, selfishness, trouble seeking, etc., and 
how to overcome them; the value and proper use of foods, the bene- 
ficial effects of the right kind of exercise, the importance of assuming 
a correct posture, the vital relation of fresh air and sunshine to health, 
the benefits of rest and relaxation and the necessity of a right out- 
look, besides many others. 

The book closes with a plea for the establishment of free institu- 
tions by the state, municipality or philanthropic individuals, for the 
care of persons suffering from functional nervous disease who have 
not the financial means to take treatment at private sanitoriums. In 
the author's words '' it is a disgrace, it is socially criminal to leave the 
nervous poor to shift for themselves." 

This contribution comes from one who, from long training and ex- 
perience in the field of mental hygiene, is able to speak with authority 
and it can, without question, be recommended as a sound and practical 
guide to the art of right living and thinking. 

I. A. Field. 



Roy Franklin Richardson. The Psychology and Pedagogy of Anger, 
Warwick & York, Baltimore, 1918. p. 100.' 

In this little book, Professor Richardson has summarized the results 
obtained from a dozen Qark University students, trained in intro- 
spection, who attempted to make full observations of their emotions 
for a period of three months. Their reports are classified under the 
following chapter headings:- Mental Situations Stimulating An^er; 
Behavior of Consciousness; Disappearance of Anger; Conscious 
After-effects; Educational Function. 

Prof. Richardson's subjects find that while the psychic background 
of anger may be a general irritation tending to focus on some par- 
ticular person or object, or the inducement of negative self- feeling 
for which the anger compensates, the balance of evidence goes to prove 
that Wundt's conscious fore-period is ordinarily absent, the emotion 
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of anger seizing the person suddenly without any awareness of its 
genesis. The conscious response to the emotion may be one of three 
types: 

1. "Attributive reactions," in which the angry person indulges in 
all types of mental imagery whereby he expresses his feelings (in 
imagination only), or builds plans for future revenge, etc. 

2. "Contrary reactions," in which religious and moral beliefs con- 
trol his conduct so that he restrains his wrath and " loves his enemy." 

3. "Indifferent reactions," in which the helpfulness of the angry 
person leads him to make the best of the situation and assume a philo- 
sophical attitude of indifference. 

By far the largest percentage of anger reactions fall under the first 
class. The second class conforms so closely to the psycho-analytic mech- 
anisms of repression and defense that it is a pily the author did not 
take time to point out the analogy and give us his opinion concerning 
the application of the Freudian principles developed in connection with 
the sexual emotion to other instincts and emotions. 

An affective attitude of pleasantness or unpleasantness may be con- 
comitant with anger, accordingly as it does or does not find adequate 
relief in expression. Only in cases where it is fully and completely 
vented upon its object or in some substitutive activity does anger fin- 
ally disappear. Controlled anger tends to return to consciousness re- 
peatedly. Here again it is to be suggested that the introspective results 
confirm expectations which would be created by an application of the 
psycho-analytic rubrics. 

The after-effects of anger are varied,— pity, shame, anxiety, contri- 
tion, pleasure, increas.ed friendliness, relief, curiosity, fear, etc., are 
listed, and seem to depend on the complex of factors which go to 
make up the stimulus situation and the type of subjective reaction. 
This ambi-valent swing into another emotion has been explained by 
Cannon and other investigators on a physiological basis, and the chap- 
ter would be more comprehensive had Prof. Richardson chosen to 
supplement his introspective material with a reference to these 
findings. 

The chapter on educational functions is rich in pedagogical sugges- 
tions. It is impossible to over-emphasize the motivating power of 
held-over anger attitudes in human conduct, and the teacher who 
knows how to arouse and guide anger aright is indeed wise. Each 
individual pupil must be studied, for where anger may prove an in- 
centive to greater effort in one, it may be the source of discontent and 
a surly, mischievous attitude in another. If it can be roused against 
the proper obstacles, and sublimated into arduous labor, it becomes a 
vital factor in education. 

Phyllis Blanchabo. 
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NOTES. 

September ist, 1917, the Community Service Society, Youngstown, 
OluQ, organized and opened The Children's Service Bureau as one of 
its departments with a separate staff and board of directors. The 
plan and work of the Bureau was outlined and promoted and is now 
beix^ directed by Mr. J. M. Hanson, Secretary of the Community 
Service Society. It has been privately supported by Mr. H. H. Stam- 
baugh, who has just died, and who while living, quietly but generously 
and effectively used his personal influence and (uiances in developing 
constructive social programs. 

llie Bureau was established to be the general clearing house for 
work in behalf of children in Mahoning County. It was founded on 
the belief that by early study of the "problem children " in the schools 
and by intelligent action in meeting their individual needs, most of 
th^m can be saved to themselves and to society. This, therefore is 
what the Bureau has undertaken to prove to the community. It has 
worked in close co-operation with, and has supplemented, the Public 
Schools and the Court of Domestic Relations, and intends to continue 
doing so until provision is made from tax funds for a scientifically 
directed educatiojial program. One school of nearly 1,000 pupils rep- 
resenting 20 nationalities, was chosen as a demonstration center. Here 
every child entering the lower grades is studied to determine his 
physical condition, his mental abilities and defects, and the environ- 
mental influences. These studies are now in progress and when com- 
pleted will serve as a basis for recommending to the school such 
medical and social corrective measures, such re-classiflcation of chil- 
dren and such an altered educational procedure as this investigation 
indicates and warrants. Careful follow-up work in the homes is done 
by the schoof nurse and school extension worker. 

The Paidological department, under the direction of Dr. H. H. 
Young, has been making intensive studies of children referred to it 
by parents, the public schools, the Court of Domestic Relations, the 
Children's Home, Civilian Relief of Red Cross and the various chari- 
table and social agencies of the city. Dr. Young has been officially 
appointed by the Board of Education as their examining psychologist 
and, although not oflicially appointed, has also been doing the psy- 
chological work for the Court of Domestic Relations. 

The Bureau, because privately supported, is able to serve these two 
important public institutions and to help work out a few of the many 
problem cases they have in common. As a result of this correlation 
the rapidly accumulating evidence shows how the work of the Juvenile 
Court and of the schools is one and the same, and that there is no 
such a real differentiation in function as the existence of these as two 
separate institutions indicates and emphasizes. Time and again, the 
child referred by the schools is found to have a court record, and the 
one referred by the court is found to be the source of much annoyance 
and a problem in the schools. With such cases, the best social adjust- 
ment can be made if the child's past record and present condition be 
investigated, evaluated and interpreted by some one agency which 
serves as a clearing house in co-ordinating the various isolated at- 
temi^ of independent agencies. 
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When in 1916 the Institute^ for Public Service began issuing from 
New York City its weekly post card bulletin Public Service and other 
educational reviews it was stated that its financial backer could not be 
named. For the first time the chief- donor's name is now published, — 
Julius H. Barnes now U. S. Wheat Director and since 1917 president 
of the U. S. Grain Corporation which stabilized wheat prices during 
the war. 

Mr. Barnes' interest in "learning by doing" made him consider 
starting a boys' school. He finally decided to promote "learning by 
doing" everywhere instead of in one spot and started the Institute 
for Public Service to try out circulating facts about best practices in 
school work. The offices are at 51 Chambers street. New York city 
from which center it has conducted field surveys, clipped educations^ 
and lay journals for best practices; compiled and distributed such 
pamphlets as High Spots in New York Schools, Rainbow Pron^ises of 
Progress in Education, War Fact Tests for Every American, Teacher 
Personality Charts, Graduates Who Win and many others; answered 
questions from teachers and superintendents. 

Mr. Barnes himself as U. S. Wheat Director will value the co-oper- 
ation of the nation's teachers in securing the further patriotic help of 
children and their parents in circulating and using the truth about our 
bread supply. His offices are at 42 Broadway, New York city from 
which inquiries will be promptly answered. 

It was Mr. Barnes' suggestion, too, that during this next year the 
Institute issue from time to time teachable facts about bolshevism. 
Several bulletins were issued last year and a great many letters 
answered. For copy of these bulletins and further information address 
William H. Allen, director, 51 Chambers street, New York city. 



Dr. W. W. Charters, Dean of the School of Education of the Uni- 
versity of Illinois, will on September first become Professor of Edu- 
cation and Director of the Research Bureau for Retail Training at 
the Carnegie Institute of Technology. He will also serve as consult- 
ant on curriculum problems arising within the various technical and 
vocational divisions of the Institute. Dr. J. B. Miner, who has been 
Acting Director of this Research Bureau, will continue with the 
Bureau and will also teach some advanced courses in vocational 
psychology. 

Dr. Kate Gordon has been promoted to an Associate Professorship 
in the Division of Applied Psychology at the Carnegie Institute of 
Technology, and has been given leave of absence for a portion of 
next year to continue the investigations for the California State Board 
of Charities begun during the first semester of last year. 

Major C. S. Yoakum, Associate Professor of Applied Psychology 
at the Carnegie Institute of Technology, has become Director of the 
Bureau of Personnel Research, formerlv called the Bureau of Sales- 
manship Research. Colonel Walter Dill Scott continues as Associate 
Director of this Bureau, part-time, but he will be resident in Evans- 
ton during the greater portion of the year. 



Dr. Harry D. Kitson, Instructor in Psychology at The University 
of Chicago, has accepted the position at Indiana University, made 
vacant t^ Professor £. C. Lindley who accepted the presidency of the 
University of Idaho. 
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This paper constitutes a report upon the value of group 
intelligence rating tests, and the relations of the same to in- 
dividual examinations made by the Binet-Simon method as a 
part of a mental survey of the four industrial schools of Ala- 
bama. This opportunity came to us by request of the Chair- 
man ^ of the newly constituted Board of Control and Economy. 
This Board recognizes it to be a matter of fimdamental 
economy for it to know the kinds of mental equipment the 
boys and girls of these industrial schools possess, in order that 
the real work of the institutions may be forwarded in the 
best possible manner. 

The schools investigated are four in number, — ^the Alabama 
Boys' Industrial School, at East Lake, with a population of 
about 307 white boys, the State Training School for Girls and 
the Mercy Home Industrial School for Girls, both at Birming- 
ham, with about 45 and 30 white girls respectively, and the 
Alabama Reform School for Juvenile Negro Law-Breakers, 
at Mt. Meigs, with 264 colored boys. These children range in 
age from seven years to twenty. 

1 The request for this work on the part of the State Board of Con- 
trol and Eoonpmy wis met by the Alabama State Board of Health and 
the National Committee for Mental Hygiene. These agencies financed 
the survey. 
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Backwardness of Industrial School Population 

It is a well known fact that boys and girls selected by 
Juvenile Courts, and other social agencies, for residence at 
such institutions as these industrial schools, are backward in 
school work, — that they are in large measure what we call 
dullards and feeble-minded. 

TABLE I 

dlstributicm by age and school grade at the alabama bots' 

Industrial School 



School 


Ages in Years 


ToUls 


Grades 


7 


— 1 
8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 




Primea' 


si 


1 


2 




1 












1 






6 


V 


\ 


<■ 


2 


2 


2 


2 


4 


•2 






2 


1 


1 


22 


II 




\ 


sj. 


2 


7 


6 


6 


7 


4 


4 


9 


1 


2 


51 


III 






> 


st 


6 


6 


7 


14 


8 


4 


2 


2 




54 


IV 




1 




^ 


< 


3 


15 


12 


6 


7 


3 






51 


V 








1 


> 


< 


5 


13 


12 


10 


1 


2 




48 


VI 












\ 


i 


10 


9 


7 


9 


1 




39 


VII 














\ 


< 


8 


3 


3 


1 




16 


VIII 














1 


> 


< 


2 


2 






13 


IX 


















> 


s!. 


2 






4 


Totals 


1 


6 


8 


9 


21 


20 


41 


61 


54 




38 


34 


8 


3 


304 



Table I exhibits these facts from the point of view of school 
classification for the Alabama Boys' Industrial School. 304 
of the 307 boys examined, for whom school classification was 
stated, are classed according to age and school grade. If it is 
fair to assume that a child in his seventh year should be in the 
primary grade, in his eighth year in the first grade, in his 
ninth year in the second grade, and in his fourteenth year in 
the ninth grade, we find that there are only eight of these 
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304 children who are up to, or beyond, the expected grade. 
They are shown below the diagonal line in the table. Only 30 
other children of the 304 are in the grades immediately below 
these, or one year retarded, according to these expectations. 
The great mass of children point in the direction of the nine 
second-grade seventeen year-olds. 

The modal age is fourteen years, and the modal grade is the 
third. Likewise the maximal number of third graders is four- 
teen at fourteen years of age. The modal grade for the four- 
teen year-olds is the third, and the modal age in the second 
grade is seventeen years with nine already alluded to. Like- 
wise the median age of the second grade is fourteen years. 

The group of this Industrial School population is, in fact, 
so loaded with retarded children that this condition cannot be 
attributed to the accident of poor school facilities. Especially 
true is this when we consider what large numbers of these 
boys come from the cities where excellent school facilities are 
provided. 

Group Intelligencb Ratings 

Experience with group tests in the applications of psy- 
chology to the organization of military forces had convinced 
us of the labor-saving feature of this device in such a survey 
as this. The military tests were not available when this work 
was planned. Considering the large amount of illiteracy 
amongst these boys and girls, as indicated by the large num- 
bers classed in the lower school grades in Table I for the 
white boys, it seemed advisable to prepare two forms of group 
examination, one for children of the fourth school grade degree 
of literacy in English, and the other for children of the third 
school grade and below. The form prepared for those able 
to read English, and designated ' Form A' of Group Intelli- 
gence Hating Tests, is constructed very much on the lines of 
the Alpha Examinatioa used in the Army. It is somewhat 
shortened and introduces one performance test, namely, the 
mazes. It consists of eight parts, (1) Directions Test, (2) 
Arithmetical Performance, (3) Mazes, (4) Same-Opposite, 
(5) True-False, tDisarranged Sentences), (6) Analogies, (7) 
Choice of Reasons for Stated Facts, and (8) Arithmetical 
Series. The total possible score for these eight tests is, ac- 
cording to the method adopted, 193, and the actual working 
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time of the examinee about twenty minutes. It is, therefore, 
an easy matter to go through the whole performance with a 
group, inchiding the filling in of the headings of the paper, in 
5ie space of an ordinary school period of forty-five minutes. 

The. other form of Group Intelligence Rating, Form X, 
designed for children who have not much reading knowle^e 
of English, consists of five parts, the first four of which in- 
volve no reading of English whatever. The first is a Direc- 
tions Test, the second is a game at store keeping, marking 
goods in letters which stand for figures (a letter digit test), 
the third is a maze test, and the fourth consists of twen^ 
unfinished pictures. A cloth blackboard is carried to aid in 
the explanation of the second, third, and fourth tests. The 
first maze is on the blackboard entire, and a child is asked to 
volunteer to show the group how to get through this maze, 
by coming up and taking the chalk and making a mark from 
the arrow on the left to that on the right of the maze. The 
first unfinished picture, a girl without a mouth, isf on the 
blackboard as on the examination book, and a volunteer is 
asked to come up and finish this picture. The transition from 
unfinished pictures to unfinished sentences (Test 5) is made 
as easy as possible by the fact that both are unfinished. The 
unfinished sentence is by all odds the most difficult of these 
five tests for these relatively unlettered children, because it 
involves reading of English. The total possible s(x}rt in this 
Form X of Group Intelligence Rating is 182. The actual 
working time of the examinee is about seventeen minutes. 

In order to be as economical of our time as possible, and at 
the same time disturb the routine of the institutions as little 
as possible by our work, we proceeded first to make group 
examinations of the intelligence of the boys and girls of these 
schools by using these two forms. 

The same two forms were used about the same time on an 
aggregate of 1012 children in the schools of Jackson, Missis- 
sippi, ranging in age from five to thirteen, and in school grade 
jfrom the primer grade to the seventh, or highest grammar 
school grade. In the same. way 765 colored children in the 
schools of Jackson, ranging in age from five to fourteen, and 
in school grade from the i>rimer to the seventh, were rated 
as to intelligence, by these two forms. The percentile distribu- 
tion of ..the scores made by these Jackson schopl . children con^ 
stitute our measuring instrument for the performances of the 
boys and; girls, white and colored^ of the Alaban^ industrial 
Schools. 
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Group Intelligence Ratings of Children in Alabama 
Industrial Schools 

table II 

Distribution op Scores in A & X Forms op Group Intblucbncb 

Rating by Age op Child and by Perce n tile MAxniA op Public 

School Childrbn. Alabama Boys' Industrial School 



Per- 
centile 


Ages in Yean 


TolRit 




7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 




100 










1 




1 














2 


90 














1 


1 


3 


2 


4 


1 




12 


80 








1 








2 


4 


4 








11 


70 














1 




4 


2 


2 






9 


60 














2 


2 


2 


2 


2 






10 


50 










1 


1 


2 


3 


3 


1 


2 






13 


40 






1 




1 


1 


2 




4 




2 






11 


30 








1 




1 


1 




1 


2 


2 






8 


20 




1 


1 




2 


3 


2 


10 


8 


7 


2 






36 


10 






1 


2 


4 


5 


2 


17 


4 


5 


2 


2 




44 


5 








2 


5 


2 


4 


8 


6 


3 


4 


1 




35 


3 




4 


3 


1 


1 


4 


2 


2 


1 


3 


1 






22 


2 


1 


1 


2 


2 


6 


4 


22 


16 


15 


7 


11 


4 


3 


94 


Totals 


1 


6 


J_ 


_9^ 


21 


21 


42 


61^ 


55 


»_ 


34 8 


3 


307 



Table II presents the percentile distribution of the perform- 
ances of 307 boys of tne Alabama Boys' Industrial School 
rated by the percentile distributions of performances of Jack- 
son school children. Since we had very small numbers of chil- 
dren beyond nine years of age in the third grade in the public 
schools, nine years is the highest for which we have reliable 
percentiles in the X form of examination. Likewise our fig- 
ures for the A form of examination comprise children from 
nine to thirteen years, inclusive. 

219 of these 307 boys are beyond thirteen years of age. 
More than forty per cent of these boys took the X form of 
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examination by virtue of their retardation in school work. 
There is necessary, therefore, a certain amount of projection 
of expectation of performance with advancing age. We have 
to anticipate what a thirteen year-old might reasonably be ex- 
pected to do in the X form of examination from what seven, 
eight, and nine year-olds have done, and likewise we .have to 
anticipate what a sixteen year-old might be expected to do in 
both the A and X form from what younger children have done. 

The distribution of the scores of the Boys' Industrial School 
inmates have been made in Table II according to this simple 
plan. Any score falling below the lowest two percentile per- 
formance of Jackson sdiool children is placed in the two per- 
centile group under the age of the child making it. Any score 
falling above the two percentile, and below the three percen- 
tile limit, is placed on that level, and so on, above three and 
below five is placed in the five level, and above five and below 
ten is placed in the ten level. By this simple plan of stratifica- 
tion we have put before us another striking exhibition of the 
retardation of the minds of these boys. 151 of these boys 
put up mental performances below the limits of the lowest five 
per cent of public school children of the same ages and race. 
That forty-nine per cent of these boys are so incapable men- 
tally is really a more striking exhibition of the problems con- 
fronted by the management of such an institution than are the 
actual numbers of feeble-minded which we present later. 

This classification of intelligence of the boys abundantly 
justifies the school grading as set forth in Table I. 

Of course we have constantly to bear in mind the fact that 
the group examination does not detect the lazy individual who 
will not put forth his best effort under the conditions of such 
examinations. However, the conditions of the test were exactly 
the same in the public schools and in these industrial schools. 

In the same way Table III exhibits the distribution of 
scores of the 75 girls of the two Training Schools according 
to the percentile stratification of performances of public 
school children. 

33 of the 75 girls fall below the five percentile level of pub- 
lic school children, and only one of the whole number makes 
a score above the median performances of public school chil- 
dren, whereas 44 of the 307 boys exhibit scores above the 
median performances of public school children. This seems 
to indicate in general a lower grade mentality amongst the 
white girls of these reform schools than amongst the white 
boys. 
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TABLE III 

DisTRiBunoN or Scores in X Pomi or Group Ihtblugence Rating 

BY Age or X^hild and by Percentile Maxhia or School Children. 

State Training School for Girls and Mercy Home Industrial 

School FOR Gkls 



centiles 


Ages in Yean 


Totals 




7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


20 




100 
































90 
































80 
































70 
































60 














1 
















1 


50 












2 


1 


1 


2 




3 


1 






10 


40 












1 






1 


2 










4 


30 














2 


1 


1 


1 


1 


1 






7 


20 














1 


2 


4 


4 


1 


2 






14 


10 














1 




2 


2 


1 








6 


5 












2 


1 


1 


2 


1 


1 








8 


3 

































2 


1 




1 




1 




3 


2 


6 


5 




2 


3 


1 


25 


Totals 


1 




1 




1 


5 


10 


7 


18 


15 


7 


6 


3 


1 


75 



Table IV shows the stratification of the scores of 264 negro 
boys in the Alabama Reform School for Juvenile Negro Law 
Breakers. This stratification is made by comparison with the 
performances of 765 negro children in the public schools of 
Jackson, Mississippi. It is a very different distribution from 
what would be presented had they been compared with the 
performances of white children. 221 of these 264 boys, or 
84%, score below the median performances of children of 
their same ages and race. Judged by the standards of their 
own race, 84% of these boys are below the average of intelli- 
gence. 16% therefore, are above average intelligence for their 
race, whereas 14% of the white boys, and 1% of the white 
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TABLE IV 

DisnuBUTioN OP Scores in A A^a> X Forms or Group Intblugsncb 

Rating by Acb op Child and by Percbntilb Maxima op Public 

School Children. Alabama Reform School for Juvbnilb 

Nbgro Law Breakers 



Percentiles 


Ages in Years 


Totals 




8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 




100 








2 






1 




1 








4 


90 








1 






1 


1 


1 








4 


80 






3 






2 


4 




1 








10 


70 










2 






5 


3 


1 






11 


60 






2 


1 


1 


3 


2 


1 


2 


1 


1 




14 


50 




1 








5 


4 


2 


1 








13 


40 








5 


2 


3 


5 


4 


2 


1 






22 


30 




1 




1 


8 


15 




3 


2 


1 






31 


20 


1 






1 


7 


16 


11 


15 


14 


4 




1 


70 


10 






2 




3 


3 


15 


10 


12 


10 


2 


1 


58 


5 






1 


2 


3 


1 


7 


5 


5 


1 


1 


1 


27 


Totals 


1 


2 


8 


13 


26 


48 


50 


46 


44 


19 


4 


3 


264 



girls are above the average intelligence for their ages and 
race. 

85 of the colored boys, or 32% of the total number score 
below the limits of the lowest 10% of public school children 
of their race, and 27, or 10% below the limits of the lowest 5%. 

The scores of the colored boys do not bunch so closely m 
the lowest five percentile strata as do the white boys. A much 
larger number is found between the ten and twenty percentile 
limits than below the five percentile limit. 

But it is evident that all three of these groups, — white boys,' 
white girls, and colored boys, are over-loaded with dull chil- 
dren, white boys 86% below average, white girls 99% below 
average, and colored boys 84% below average. 

The distribution, however, within this lower half of the 
field of mental ability is very different for the three groups. 



Digitized by 



Google 



MENTAL RATING OP JUVENILE DEPENI^NTS 299 

Below the ten percentile level we find white boys M%, white 
girls 52%, and colored boys 32%. 

Below the five percentile level we find white boys 49%, 
white girls 44%, and colored boys 10%. 

On being compared with school children of the same race, 
the colored boys are, therefore, from all three of these angles, 
better endowed than the white children. While they have not 
significantly larger numbers, or percentages, above die average 
intelligence of their race, they do rank higher in the low 
groups, or strata. Whatever is the selection process of the 
courts sending these boys and girls to these schools, they 
evidently do not select negro children so closely as they do 
white children along the lines of racial dullness, or lack of 
intelligence. 

Individual Examinations 

Throughout the experience of the personnel of the Divi- 
sion of Psychology in the Surgeon General's office in sepa- 
rating the feeble-minded from the competent in the draft 
army, it was found necessary to follow the scoring of group 
performances by individual intelligence examinations in order 
to make satisfactory diagnoses and to accumulate the evidence 
necessary for discharge from the service on account of mental 
inferiority. For the most part the feeble-minded were found 
in the soncalled ' E Group ' of scores resulting from group in- 
telligence rating. This group constituted roughly the lowest 
five per cent of the draft. 

As to percentages found Terman states that 16,266 men out 
of l,0S9,/6/ examined between May 1, 1918 and September 1, 
1918, had a mental age of eight years, or less.* This con- 
stitutes one and six-tenths per cent of the gross number in the 
drafts under consideration. 

Yerkes * states later that of 1,726,000 men examined prior 
to January 1, 1919, 45,563 were of a mental age of less than 
ten years. This is 2.6% of the drafts under consideration. 
As, however, only 27,052 of these were recommended for ( 1 ) 
discharge as feeble-minded, (2) labor battalions, or (3) de- 
velopment battalions, this is probably the truer measure of 
mental deficiency as found in this draft. This number, 27,- 
052, is 1.6% of the drafts under consideration. It seems 
likely, therefore, that something like one and one-half per 

2 L. M. Terman, Psychological Bulfftin XV. June, 191$, pp. 177-187 
** The Use of Intelligence Tests in the Army.'* 

'R. M. Yerkes, Science March 7, 1919, p. 2j6, "The Measare of 
Utilization of Brain Power in the Army." 
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cent of the men who passed local exemption boards and were 
conducted to camps as reasonably suitable material for making 
fighting men were so defective in mentality that there was no 
hope of developing them into serviceable factors in the mili- 
tary organization. 

The defects of the plan of rating adults by mental age, and 
judging of their efficiency thereby, are exhibited by these 
figures. It is evident, despite the striking presentation it 
enables one to make to the lay mind of the defect of a men- 
tally inferior person, that it does not represent the facts in 
the case to say of a given individual twenty-five years old 
that he has the mind of a child of seven, or of nine years. 

The different ages represented in the developmental period 
by these children in the Alabama Industrial Schools compli- 
cates our problem considerably beyond that confronting the 
military psychologist. We have to treat each age g^oup up 
to sixteen as a distinct group and to compare the score of each 
with the scores of normal children of the same age and race. 

As a matter of practical procedure, being compelled to pro- 
ceed with our individual examination work before the stratifi- 
cation of scores of public school children was completed, we 
arranged the scores in each age group, for each race and sex, 
and for each form of the examination, in order of their mag- 
nitude, and proceeded with the children making the lowest 
scores up in the lists until we felt satisfied we had reached a 
point beyond the level of feeble-minded performance. This 
empirical procedure probably involved a little more labor than 
would have been necessary had we had at our disposition the 
stratification of public school children's performances. How- 
ever, with this classification of public school children's per- 
formances in hand we would have proceeded in exactly the 
same way, only being enabled to stop a little short of the point 
to which we mounted in each group. For mental age rating 
we used the Stanford Revision of Binet-Simon Tests. 

Value of Group Tests 
The first point in favor of the use of group intelligence 
rating methods in such institution surveys as these herein 
rep6rted, consists in the facilities afforded for a quick and 
fairly accurate intelligence rating of every individual in the 
survey. It is a matter of decided value to the Superintendent 
and management of an institution, just as to the personnel 
officer in a division of the Army, to know of each individual 
that he is above, or below the average in intelligence, and how 
much above or below he is. It is of service to such management 
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to know that one-half of the children are as low down in ability 
to adapt themselves to their environment and to learn how to 
do things as the lowest five per cent of public school children 
of their same ages and race. 

There is no question about the labor saving effected by this 
device when one is setting about the survey of an institution 
population with the specific object in mind of sorting out the 
feeble-minded. It is a much more effective procedure to make 
group tests and get the scores than to discuss intelligence capa- 
city and possibility of mental deficiency with the Superinten- 
dent and teachers. This situation has not changed in the 
twenty years since Binet called attention to the very poor 
ability of the average teacher to diagnose, or to aid in the 
diagnosis, of i^ental deficiency in the case of any child in her 
room. Any who have ever tried this method of discovering 
which children in a given group should be submitted to an 
individual examination for mental age rating and social prog- 
nosis know how exceedingly unsatisfactory it is. Such persons 
know that one must practically examine every child in order to 
be reasonably certain he has not passed over some mental 
defectives. 

By this method we found it unnecessary to extend our in- 
dividual examinations beyond about one-third of the white 
boys and white girls, and a little over one-half of the colored 
boys. This is some curtailment of labor. 

Of the boys and girls actually examined individually, ap- 
proximately one half were found to be feeble-minded. 

As stratification of intelligence of school children proceeds 
to larger numbers, and we can state with more definiteness the 
expected performance of the lowest two per cent, the lowest 
three per cent, and the lowest five per cent of children of each 
age through the developmental period, we shall be able to 
come closer to the feeble-minded group by the group method 
of intelligence assessment. As this approximation is made, 
more labor in individual examination will be saved. 

Of course this is an asymtotic approximation, the special 
factor precluding diagnosis of mental defect by the group 
method alone being the impossibility, already referred to, of 
detecting that species of volitional interference with the pro- 
duction of good results in an individual, otherwise capable, 
under the conditions of the group method of intelligence test- 
ing. There will always be individuals who will do less than 
they are capable of performing. Some such will, in any group, 
have to be interviewed and examined individually in order to 
demonstrate that they are not as poorly equipped as their 
group intelligence rating results indicate. 
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TABLE V 

Relation of Group Scores to Diagnoses Resulting prom 

Individual Examinations 
Total Numbers op 

(1) Scores as of towestfhwpercentifepiil^ school childrm 

(2) Qiildren assigned mental age by Stanford Bin^ 

(3) Diagnoeed as Fe^le-minded (institution cases). 

(4) IKagnoeed as BoRler-line(pix)bal^ institution cases). 

(5) Diagnoeed as not Fe^le-minded as result of individual examina* 
tion and mental age rating. 





White Boys 


White Girls 


Colored Boys 


Numbers scoring in 
Group Rating as of 
Lowest 5 Percentile 


151 (49%) 


33 (44%) 


27(10%) 


Numbers ^mme^ 
Mental A^ by Stanford 

tion 


94 (31%) 


25 (33%) 


140 (53%) 


Numbers diagnosed as 
Feeble-minded 


44 (14%) 


16 (21%) 


57(22%) 


Numbers diagnoeed as of 
B(^er-line Intelli- 
gence 


13 ( 4%) 


3 ( 4%) 


42 (16%) 


Numbers diagnosed as 
not Feeble-minded by 
Individual Examina- 
tion. 


37 (12%) 


6 (8%) 


41 (16%) 



Table V exhibits for the three classes of children examined* 
the. total numbers rating themselves below the five percentile 
limit of public school children of the same race, and, in par- 
entheses beside these figures the percentages which these 
numbers constitute of the total numbers of those examined. 
The next line presents the numbers and percentages of each 
group submitted to individual examination ; the next, the num- 
bers and percentages of each group diagnosed as feeble- 
minded; the next, the numbers and percentages diagnosed 
as of border-line intelligence; and the last, the numbers and 
percentages submitted to individual examination but pro- 
nounced not feeble-minded. It should be stated parenthetic- 
ally at this point that considerable numbers of boys and girls 
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submitted to individual examination and found not to be feeble- 
minded were found to be constitutionaJly inferior persons, 
or epileptics, or psychopaths, and for these reasons Hkdy to 
prove constant public charges on account of criminial tenden- 
cies growing out of their abnormal characters. Many chil- 
dren were seen individually and partial mental examinations 
made, for whom no mental age assignments were made. 

An out-standing feature of this Table is the very laVge per- 
centage of negro boys given individual examinations. It will 
be noticed also that a considerably larger percentage of these 
negro boys are diagnosed as feeble-minded than of the white 
boys, and a very much larger percentage of the negro boys 
are diagnosed as of border-line intelligence than of either 
white boys or white girls. It is a fact that we are without 
data in regard to the reasonably expected performances by a 
Binet-Simon form of examination of negro children at the 
various periods of development. The standardization of in- 
dividual intelligence rating has been done with white children. 
We do not know what to expect of negro children. As a 
consequence of this defect in our methods of applied psy- 
chology we found ourselves more at a loss in mdcing prog- 
noseis of these n^o boys in Alabama than in respect to the 
white boys and girls. 

The group tests with Jackson school children, and the work 
with group tests in the Army, have shown unquestionably the 
backwardness and inferiority of the mental development in 
the negro as compared with that in our white population, but 
we are entirely without a guide as to the measurement of 
this inferiority in terms of years and months. We have no 
standards by which to judge what degree of intelligence is 
. required of a negro boy of a given age in order to. warrant 
us in predicting his ability to 1^ such that he will be able to 
manage himself and his affairs with prudence in thi^ civiliza- 
tion of ours. Consequently, we have taken refuge in classing 
a larger number of them as of border-line intelligeriee. At 
the siame time we have found it necessary to examine indi- 
vidually a far larger number of them, and have classed a larger 
percentage of them as feeble-minded than of either 'white boys 
or white girls. 

Certain it is that if we judge these negro boys by the stand- 
ards established for white children, we should find tWo thirds 
of the population of the Alabama Reform School for Juvenile 
Negro Law Breakers subjects for state care as mental defec- 
tives, and we should also find very large peitentages of 
negro children in the pubKc schools subjects for state care. 
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Manif^tly the practical results of allowing negroes of such 
inferior intelligence, judged by white standards, to undertake 
to milage for themselves, are not disastrous. We are not 
likely to have to look after larger percentages of negroes as 
state wards than we do of the white population. It is, there- 
fore, a scientific desideratum of the highest import that we 
should have a standardization of the Binet-Simon Tests to 
the development of negro intelligence. 

Another feature of contrast between the races manifest in 
our results is a wider percentile distribution of the negroes 
as distributed according to the strata of performance of public 
school children. Of the white boys and girls given individual 
examinations, only three had scores in the ten percentile group, 
that is, above the five percentile limit, two of them boys, eleven 
and twelve years old, made, on individual examination, intelli- 
gence quotients of 100 and 104; the other, a girl seventeen 
years old, made ah X score of 102, but on individual examina- 
tion made an intelligence quotient of 59, her mental age being 
9.4. This girl, it should be said, was called in for individual 
examination more on the strength of a statement by the Super- 
intendent than on account of her showing in the group tests, 
and she was rated as a psychopathic personality r^ly suffer- 
ing from an incipient psydiosis. As a result of this condition 
she shows two different mentalities, one in the group test 
which is good, and another in the individual examination which 
is inferior. 

On the other hand, the negro boys called for individual ex- 
amination and found to be feeble-minded range high in the 
percentile stratification of their group scores. 

Table VI exhibits these facts, showing that the majority of 
the five percentile group (63%) were diagnosed feeble-minded, 
only 43% of the ten percentile group, 20% of the twenty per- 
centile group, and 3% of the thirty percentile group. Like- 
wise,, diccreasingly small proportions of these groups were 
called for individual examination. 

The distribution of examinees and the resulting diagnoses 
of these negro boys shown in Table VI indicate that the stand- 
ard of f eeble-mindedness for the negro boy, which the exam- 
iners had in mmd in their work, cuts through the percentile 
distribution of group scores of negro children at about the 
twenty percentile level. This twenty percentile level in negro 
children seems to correspond closely to the two percentile 
level in white children. ^% of the five percentile white boys 
are found feeble-minded, and none above the five ^percentile 
group* 45% of the five percentile white girls are found feeble- 



Digitized by 



Google 



MENTAL RATING OF JUVENILE DEPENDENTS 



305 



minded, and, as just explained, no real case is found above 
this group. On the other hand 36% of the lowest twenty 
percentile group of the negro boys are feeble-minded, and one 
case is found above the twenty percentile level. 

TABLE VI 

Distribution op Group Scores op Negro Boys Given Individual 
Examinations, and Numbers op Each Group Found Pebble- 
Minded, Borsxr-lvne and not Peeble-mindbd 



P^centile 


Numbers 

in 
Groups 
(Table 

IV) 


Numbers 
Exam- 
ined 
Indivi- 
dually 


Found 
Feeble-minded 


Diag- 
nosed 
Border- 
line 


Diag- 
nosed 


Group 


Numbers 


Percentsof 
groups 


Not 
Feeble- 


5 Percentile 


27 


27 


17 


63% 


8 


2 


10 Percen- 
centilc 


58 


51 


25 


43% 


14 


12 


20 Pcrccn- 
tUe 


70 


47 


14 


20% 


17 


16 


30 Percen- 

tUc 


31 


13 


1 


3% 


2 


10 


40 Percen- 
tile 


22 


1 






1 




80 Percen- 
tile 


10 


1 








1 



Reasons for this Scattering of the Negro Feeble- 
minded 
We cannot satisfactorily explain this disparity of results 
of correlation between group and individual examinations for 
the white and colored populations. The following, facts, how- 
ever, may be taken in partial explanation of this disparity : 

(1) Smaller numbers of negro children were e;camined in 
the public schools; 765 stratified scores as contrasted with 
1012 for white children. It was also noted in this strati- 
fication that there were numerous cases of maxima for older 
children falling below maxima for younger children at the 
same levels. 

(2) It is a question how far the streaks of brilliance found 
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occasionally in mulatto children may interfere with the work 
of standardization in such a school population. Of coarse 
large numbers will overcome this, but it is a distinctly different 
element from any found in a white school populatiM. 

(3) Unquestionably the greatest source of error, and the 
greatest factor in producing this disparity of results is the un- 
certainty of age of n^ro children. Both in the public schools 
and in the reformatory we find negro children absolutely ig- 
norant, not only of date of birth, or time when birthday comes, 
but also of the ntmibers of years of age. Constantly such 
children and their teachers guess at the age. This ignorance and 
apparent attempt to deceive in regard to age so impressed us 
at the Juvenile Negro Reformatory that we came to rely al- 
most entirely upon our own judgment of the age of the boy 
from what we could observe of his size, growth, and physical 
development, especially of the secondary sex characters. 
Facts of this sort observed seemed to us very much more 
reliable than the statements of the boy. No reliable school 
records were found in either the Reformatory or in the public 
schools. A special factor making for the unreliability of stated 
age in the Reformatory consisted in the fact that boys over- 
stated their age with the hope of early dismissal from the 
institution. 

(4) The more tentative character of diagnosis of feeble- 
mindedness in the negro child as a result of individual ihen- 
tal examination and age rating, which has already been re- 
ferred to, constitutes another possible source of this disparity 
stated for the two races. 

The Two Per Cent Strata of Intelligence In White 

Children 

Of the 94 white boys given definite mental age rating as 
a result of individual examination by the Binet-Simon me&od, 
43 were found to be feeble-minded, and 41 of these had made 
scores by the group tests falling below the lowest two per- 
centile level of public school children. The other two found 
feeble-minded were between the two and three percentile level 
of public school children in their group scores. 

Of 13 white boys diagnosed as of border-line intelligence, 
10 in their group scores fell below the two percentile level 
of public school children; two others below the three per- 
centile level; and the remaining one below the five percentile 
level. 

The remaining 38 of these 94 white boys who were diag- 
nosed as not feeble-minded are divided as u>IlowS' in regard to 
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tfieir percentile ratings. 24 fell below the two percentile level ; 
9 others below the three percentile ; three others below the five 
percentile level ; and two below the ten percentile level. From 
this it is evident that all the f eeble-mimled would be caught 
in the net of the group tests by adhering to the three per- 
centile level. Only six boys who made scores above this level 
were seen in individual examination. One of these was diag- 
nosed as of border-line intelligence, and the remaining not 
feeble-minded. It is likewise evident that practically all the 
feeble-minded would be found by further sorting over by the 
individual examinational method those boys scoring in the 
group tests below the two percentile level. 

In the two schools for white girls, 25 girls were called for 
individual examinations and given mental age ratings. 21 of 
these were below the two percentile level, the remaining 4 
being below the five percentile level. None of these girls rated 
between the two and three percentile level. 

15 of these 21 girls below the two percentile level in group 
tests were found to be feeble-minded; 3 of border-line in- 
telligence ; and 3 not feeble-minded. Of the 4 girls rating as 
of five percentile intelligence, one was found to be of border- 
line intelligence, and three not feeble-minded, as the result 
of individual examinations. 

In these three groups of white children numbering 382 in 
all, 119 scored by the A or the X form of group intelligence 
rating below the limit of the lowest two per cent of 1012 white 
public school children. 

Had the individual examinations been confined to these 119 
children, we would have found 56 of the 58 whom we diag- 
nosed as feeble-minded as the result of individual examina- 
tion, and 13 of the 17 for whom we made provisional diag- 
nosis as being of border-line intelligence. 

Using the group tests as the first screening process, and as- 
suming the two percentile limit to have corralled practically 
all of the feeble-minded, it is seen we would have saved a 
considerable amount of effort by this use of the group method 
of intelligence rating. This two per cent would comprise a 
considerable number of dullards, and some, perhaps, who arc 
not dull, but for one reason or another would not put forth 
their maximal effort under the conditions of the group test. 
Many of these, too, are defective characters, — constitutional 
inferiors, who constitute most serious problems for their care- 
takers. These need most careful attention from the psychia- 
trist. Others of this class will be picked from those making 
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higher scores by their behavior, and by the reported difficult 
they cause the management. 

Individual mental examination made in this two percen- 
tile group, which in these schools constitutes less than AO^ 
of the population, will clear, apparently, about two-fifths of 
the individuals from suspicion of being feeble-minded. It 
will pronounce them able to learn and to adapt themselves 
to their environments so as to be able to manage themselves 
and their affairs with prudence, and will, therefore, consider 
them as constituting no danger to themselves, or to others on 
account of defects of intelligence. 

About one half of the two percentile group of these white 
children prove to be clearly feeble-minded in the sense of this 
definition just given. The remaining ten per cent of the group 
we found it necessary to provisionally diagnose of border- 
line intelligenQe. We mean by this that our observation has 
not been sufficient to enable us to pronounce the child so 
designated as feeble-minded, or as not feeble-minded. We 
must leave the definite diagnosis to further experience with 
the child. In many cases we feel that a longer period of ex- 
perimentation with him is necessary before a definite diagnosis 
can be given. In fact, with many children of this class the 
pragmatic test t)f experience alone will demonstrate whether 
or not the individual is simply a dullard, defective in some 
range of imagination, and entirely capable of managing him- 
self and his affairs with prudence, or whether he is so defective 
through inheritance that he will have to be looked after by 
the community in order to keep him straight and to save the 
expense of his crimes and pauperism. 

From this point of view the g^oup tests work out very 
much as would be expected. Army results show about one 
and one half per cent of the young adult male population to 
be feeble-minded. It is usually conceded that about one per 
cent of the total population are feeble-minded in the sense 
that they have not intelligence enough to manage themselves 
and their affairs with prudence, and hence need community 
care to save the expense of their own short-sightedness. If 
these g^oup tests really measure the intelligence of the chil- 
dren, it should be possible to find all of those who are so de- 
fective as to need community care within the group of the 
lowest two percentile level of public school children. Finer 
work in the future with group tests may possibly bring us 
yet nearer to an ultimate sorting out of the feeble-minded by 
the group method of examination alone. 

Without doubt the group intelligence ratings of negro chil- 
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dren can be made much more serviceable when a means is 
found of ascertaining definitely the ages of children examined. 

Summary 

(1) Group Intelligence Rating scores of white boys, white 
girls, and ccriored twys, of Alabama Industrial Schools are 
stratified by the percentile achievements of 1012 white chil- 
dren and 765 colored children of the schools of Jackson, 
Mississippi. 

(2) Only 8 of the 307 white boys are up to the expected 
sdiool grade. Pnly 30 others are as little as one year re- 
tarded. 

(3) The following percentages score below the 50% level 
of public school children: White boys 86%, white girls 99%, 
colored boys 84%. 

(4) The percentages below the ten percentile level for the 
three groups in the above order are 64%, 52%, and 32%. 

(5) The percentages below the five percentile level for the 
three groups in the above order are 49%, 44%, and 10%. 

(6) The feeble-minded white boys and white girls, and 
those provisionally diagnosed as of border-line intelligence 
are practically all found among those scoring below the low- 
est two per cent of public school children. 

(7) This shows the group test to be a labor-saving device 
in such mental surveys of institutions. Three-fifths of the 
lowest two percentile scores are feeble-minded or of border- 
line intelligence in the three schools for white children sur- 
veyed. 

(8) A larger percentage of neg^o boys had to be examined 
individually in order to catch the feeble-minded, and these 
boys' scores in the group tests range up to the thirty per cent 
level of intelligence of colored children in the public schools. 
In fact the twenty per cent level in colored children seems to 
correspond closely to the two percentile level in white children 
as a group score limit of feeble-minded intelligence. 

(9) Ignorance of actual age in colored children may be 
responsible for this disparity of results. 

(10) Uncertainty of the applicability of Binet-Simon stand- 
ards to the mind of the negro child may constitute another 
reason for this disparity in the relations of group and indi- 
vidual intelligence examination results in the two races. 

(11) Numbers and percentages diagnosed feeble-minded 
for the three groups are as follows: White boys 44 (14%), 
white girls 16 (21%), colored boys 57 (22%). 
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COMPARISON BETWEEN TWO SCALES FOR 
THE ESTIMATION OF INTELLIGENCE 



By Hasiy Dexter Kitson, Indiana University 



In view of the prevailing interest in methods of estimating 
abilities, the writer undertook a comparative study of two 
varieties of scales for the estimation of intelligence. 

The first, devised by Pearson, has apparently not Ijeen used 
in America except at The University of Chicago where it 
is a part of the program of psychological investigatioa which 
the writer carried on for a number of years.^ Some data re- 
lative to the use of the scale in this connection have been 
presented by Ruml.* 

The second scale was first used* in connection with 
psychological investigations upon the ability of sales- 
men. The idea formed the basis of the Army Officer's Rating 
Scale and is now being used as the basis of several other rating 
scales in process of development. 

The Pearson scale (hereafter designated, Scale I) is de- 
scribed at length in Biometrika* but lest the files of that jour- 
nal be inacessible to some readers a summary will be given 
here. The scale consists of a number of classes or degrees 
of intelligence which were defined by Pearson substantially 
as shown in the form below. On the basis of this classifica- 
tion a number of headmasters and teachers in English schools 
were requested to rate their pupils. The persons rated in- 
cluded children in grammar school and students in Oxford 
and Cambridge, totaling about 5,000. 

Assuming that the distribution of intelligence follows the 
curve of probability, Pearson plotted the estimations along 
this curve ; found the numerical value for each class by deter- 
mining the point on the scale corresponding to the mean value ; 
determined the limits by finding the deviations from the mean 

^Kitson, H. D. The Scientific Study of the College Student 
Psychol. Rev. Mon. Sup. 1917, Vd 23, No. i. 

* Ruml, B. The Reliability of Mental Tests in the Division of ap 
Academic Group. Psychol. Rev. Mon. Sup. 1917. Vol. 24, No. 4. 

'"Aids in Selecting Salesmen/' published by Bureau of Personnel 
Research, Carnegie Institute of Technology, November, 1916. 

^Pearson, K. Relationship of Intelligence to Size and Shape of 
Head. Biomeirika, Vol. V., 1906, pp. 105-46. 
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(measured in terms of the S. D.) required to include in each 
class the observed frequency. 

The S. D. was approximately 100, and so the range of the 
two classes marked " Fairty Intelligent " and " Slow Intelli- 
gent" was divided into 100 parts called mentaces. Pearson 
called average intelligence Zero, and expressed standings 
above and below by plus and minus scores. The numerical 
values of the classes were found by determining the number 
of cases falling between the averages for each two classes 
(based on the probability integral). These values are shown 
in Table I. This table differs from the original one of Pear- 
9on's, in placing average intelligence at 300 and indicating de- 
viations above and below, by steps; thus eliminating the use 
of plus and minus signs to indicate deviation above and below 
tfie average. It also contains intermediate steps between the 
mid-points of Pearson's classes allowing finer discrimination 
for such judges as care to use them. 

TABLE I 

Numerical Values of Classes and Sub-Classbs 

M-h471 0+337 0+220 S+96 

M 451 O 322 Q 192 S 62 



6+2 
Q-1 



M— 416 O-302 0-177 

N+391 

N 371 P+282 R+157 

N— 353 P 262 R 130 

P-242 R— 116 

At the close of each quarter of the university year instruc- 
tors of students in the School of Commerce and Administra- 
tion are given the blank reproduce herewith, with the re- 
quest that they rate their students. Each student thus receives 
tfiree estimations in the course of nine months, thirty-six dur- 
ing his entire course. These are added and averaged, thus 
giving basis for a rank upon the scale of intelligence. 

Classification of Intelligence 
In order to standardize judgments on mental ability, the 
following classification of intelligence has been selected. 
Please note that the scale covers the range of the population 
at large from the genius to the imbecile. 

On the accompanying blanks, please place the. letter stand- 
mg for the class in which you judge the student's mental 
capacities to fall. What is desired is a judgment of general 
intelligence and not of classroom performance. If the in- 
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CbM 

CbM M— EfpcdaOj Abk: A awid ttpcdaJtj brigte and 
ifuiek booi M pcxccpCioo asd in 
tomcd to fcasoD nubdy about 
even when tlie data arc norcL 

CbM N— <:^»Me: A nund less Hkelj than M to originate 
inqtttrjr, but qmck in p c f cep li o n and rrasonine 

Qasi O — Fasfiy Intelligent: A mind readj to grasp and 
c^lable of perceiving {a<Ss in most fields; capabk of good 
reasomng with moderate effort. This gioup con^Mises, say, 
one-third of the total population. 

Class P — Slow IntdHgent: A mind slow general^, al- 
though possibly more rapid in some fields, bat quite sure of 
knowlei^e once acquired. 

Class Q — Slow: A mind rery slow, but not incaqiable of 
progress, granted time and considerable effort 

Class R — Slow Dull: A mind c^nbk of perceiving re- 
lationshsp between facts in some few fields with long and con- 
tinuous effort, but not generally or without external aid. 

Class S^Very Dtill : A mind capable of hcriding only the 
simplest facts, and incapable of reasoning about or graspii^ 
the relationship between facts. This group passes into the 
mentally defective. 

Class T— Imbecile 



According to the second method (hereafter designated. 
Scale II) each judge makes his own scale. He chooses from 
among university students whom he has met, five who possess 
the degree of intelligence denoted by the five steps on the 
scale. Then he compares each person to be juc^ed, with 
each member of the scale and assigns him the appropriate 
numerical value. As heretofore applied, this method has been 
ufted in making estimations concerning complex abilities which 
are subdivided into simpler qualities : ability as an army offi- 
cer, for example, into physical qualities, intelligence, leader- 
ship, personal qualities, general value to the service. Being 
concerned in the present study only with intelligence, the 
writer chose this single trait, modeling directions for rating as 
closely as possible according to the directions for rating army 
officers. The blank given to instructors is reproduced here, 
and will make further explanation unnecessary. 
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Rating Scale For Use in Estimating Intelligence 
This scale is designed to give basis for the scientific esti- 
mation of intelligence, defin^ as : "the general capacity of 
an individual consciously to adjust his thinking to new re- 
quirenents ; it is general adaptability to new problems and con- 
ditions of life." 

Highest IS Low 6 

High 12 Lowest 3 

Middle 9 

How TO Use the Scale 

From your acquaintances among university students select 
five that range from highest to lowest in intelligence. 

Place the most intelligent one in class rating 15. Place the 
least intelligent one in class 3. Select one halfway between 
these two, of about average intelligence ; place him in dass 9. 
Select one who ranks halfway between the middle one and the 
highest and place him in dass 12. Select one who is half- 
way between the middle and lowest and place him in dass 6. 

Now take the student whom you are rating and compare 
him with each of the five in your scale. Give him the number 
of points following the name of the student he most nearly 
equals. If he falls between two students in the scale give 
him a number accordingly (e.g.', if between Low and Middle ' 
give him 7, 7j4 or 8). 

Points For Special Attention 

1. Use as your criterion only General Intelligence, disre- 
garding moral and volitional qualities and scholarship record. 

2. In making your scale use students who exhibit clearly 
the degrees of intelligence assigned to them. 

3. TTie names of the highest and lowest must represent 
extreme cases. 

4. Your scale must be evenly graduated. There should 
be equal distances between the several steps. 

For the purpose of this investigation 100 students were 
chosen who had been rated the greatest number of times since 
the adoption of Scale I. Their names were then given to the 
instructors with the request that they rate the stud^ts accord- 
ing to Scale II. It should be stated that the members of the 
faculty are accustomed to making estimations about students, 
a systematic plan having been in operation even previous to 
the adoption of the Pearson Scale; and they responded wiU- 
ingly and whole-heartedly to the request. 
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Results 


AND Conclusions 

TABLE II 










Number of Judgments 


Average Sooces 


CorrelatkMMwith* 




Min. 


Max. 


Av. 


Min. 


Mai. 


Av. 


M.V. 


%D. 


Grd's P.bJtmU P.B. 


Scale I 
Scale II 


3 

1 


20 
7 


10.1 
3.0 


257.0 
5.2 


421.0 
13.4 


331.8 36.0 
9.9 0.91 


10 
10 


.62 
.66 


.004 
.012 


.40 
.32 


.088 
.094 



These scales, so dissimilar to the naked e^e, containing 
different definitions of intelligence, and requiring different 
techniques in manipulation, nevertheless give results of great 
similarity, as will be seen from an examination of Table II. 

The first thing to strike one's attention is the high average 
intelligence imputed to this group of university students ac- 
cording to both scales. In terms of Scale I the average for 
the population-at-large is 300 mentaces; that for these stu- 
dents, 331.8. According to the construction of Scale II the 
average for all university students is 9; that for these stu- 
dents, 9.9. The facts are shown graphically in Graphs I and 
II, representing the distributions of ratings made by the two 
scales. The curves both skew toward the upper levels of in- 
telligence. That for scale II is the more nearly normal, prob- 
ably because the norm taken for the judgments was the 
university student of medium intelligence, while the norm taken 
for Scale I was the average intelligence of the population-at- 
large. The data give good indication that both scales are 
able to differentiate a university group from a non-selected 
group. 

As to the consistency of the two scales in arranging the 
members of this selected group with respect to eadi other, 
the index of correlation between the two series of ratings is 
.61, ± .042, certainly significant, though not remarkably high. 

As to the respective values of the two scales in measuring 
intelligence, we have only indirect light. The only access we 
have to this elusive trait is that gained through its expres- 
sions. Two commonly accepted expressions available for this 
investigation were academic grades and combined scores made 
in the psychological tests given to each student in his fresh- 
man year.® Ratings made with Scale I correlate with grades 
by .62, ± .004; ratings made with Scale II correlate with 
grades by about the same amount. Ratings made with Scale 

^ Correlations computed according to formula for adapting the 
Pearson method to rank-differences. 
• loc. cit. 
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I correlate with scores made in the psychological tests by 
.40, ±.068; ratings made with Scale II correlate with test- 
scores by a closely similar amount. These figures tell us 
nothing about the relative accuracy of the scales in measuring 
intelligence. They iniform us merely that rating by Scale I 
is about as effective in approximating academic grades as is 
rating by Scale II ; and is about as effective in approximating 
scores made in the psychological tests as is rating by Scale II. 

Both series of ratings correlate more closely with academic 
grades than with psychological test scores. This may argue 
that in rating, the instructors used the kind of ability leading 
to scholastic attainment as their chief gauge of intelligence. 
This conclusion is favored by the fact that when the two series 
of ratings are combined, the resulting series correlate with 
grades by .76, ± .028; with tests, by only .39 ± .089. 

Both series of ratings agree with the available criteria of 
intelligence to about the same extent. Does this consistency 
mean that there is but one thing measured by the two scales 
even though it is given different definitions and different unit- 
steps? Or does it mean that the instructors made the same 
scale out of both? That in spite of their efforts to use a 
different technique in the two cases, they unwittingly em- 
ployed the same? The writer is prepared to view the latter 
as a plausible contingency. It is possible that in making such 
estimations each judge prefers his own fixed method of 



US' 



Aoo«r4iBf w B«ftl« I. 



lO 



Ifeatacei 




%^^ T? 7? 3fr 35 ^F 7? fr ?>5" 



Digitized by 



Google 



316 



Kirsm 



procedure and leans toward it in spite of his efforts to adapt 
himself to the re<}uirements of one scale or another. 

These similarities in the operation of two apparently dis- 
similar scales stsggest that in these days when rating scales 
are sprii^;ing up so abundantly, time should be taken for com- 
parative investigations. It is quite likely that two methods 
which at first blush seem widely divergent may turn out upon 
statistical analysis to be quite similar after all. 
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THE AVERAGE MENTAL AGE OF ADULTS 



By Edgab a. Doll» Fellow in Psychology, Princeton Utiiversity 



Three years ago Professor Lewis M. Terman came to the 
conclusion that tfie average mental age of adults is approxi- 
mately 16 years. This conclusion is still generally accepted 
and still determines the calculation of intelligence quotients. 
Terman based his conclusion on the fact that the median men- 
tal age of a fair number of supposedly unselected adults 
proved to be 16 years by the Stanford revision of the Binet- 
Simon scale. Terman made no attempt logically to explain 
the fact nor to elaborate the various implications of his con- 
clusion. Arthur S. Otis, however, by logical analysis and by 
the application of results obtained by Terman and Kuhlman, 
showed that the curves of distribution of intelligence at differ- 
ent age groups tended to approach each other more and more 
dose^ until the curves of distribution for ages above 16 
practically coincided with the 16-year curve. Otis, therefore, 
concluded for logical reasons, making use of the best data 
available, that 16 years was the upper limit of intelligence de- 
velopment on the average. Strangely enough, these conclu- 
sions aroused comparatively little discussion, but were 
accepted practically at face value. Many psychologists were 
surprised that the average intelligence of adults proved to be 
so low, but those who experimented for themselves, came 
rather generally to the same conclusion as did Terman. A 
few isolated studies showed that the intelligence of different 
social classes and of different Occupational groups varied 
rather definitely, but no attempt was made to obtain any large 
number of really unselected adults, made up of the represen- 
tative proportions of the different social levels that are found 
in society at large. 

Psychological examining in the Army, however, has indi- 
cated that for unselected adults, as judged by draft recruits, 
a mental age of 16 years is in all probability much too high for 
the American average adult, at least as he was observed in the 
Army. The results of the application of group tests at differ- 
ent Army cantonments indicated wide differences in intelli- 
gence according to geographical sections of the country. They 
indicated very important influences of selections, even in 
groups of over ten thousand. It was also found that occupa- 
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tional groups were of strikingly different levels of average in- 
telligence. Furthermore, sudi studies as were made of 
foreign-bom and negroes, indicated very striking differences 
according to nationality and race. 

Perhaps it is too early to come to any general conclusions 
r^arding the significance of the Army data. Perhaps it is 
impossible for any one man at any one or even several camps 
to come to a final conclusion, because of the differences just 
mentioned in the selected nature of supposedly unselected 
groups. The fallibility of statistics based even on thousands 
of cases was amply demonstrated in the Army examining. In 
spite of highly objective methods, which were almost totally 
independent of any personal equation of examining and scor- 
ing, the different camps reported strikingly different results, 
and even the same camps reported striking variations. At 
Camp Dix, for example, the average intelligence scores of 
successive draft quotas became progressively lower during the 
period of January to August 1918, although apparently there 
was no good reason why they should do so. For these and for 
other reasons, it is advisable to wait until the Sui^eon-Gen- 
eral of the Army or the National Research Council presents 
the official results of psychological examining in the Army. 
The present writer, however, has fotmd so much demand for 
statements of the Army results, and so much need for revision 
of former concepts, that he feels it is now very desirable to 
present some sort of statement, even if it be only preliminary, 
regarding the average intelligence of adults as seen in the 
Army. In so doing he will present only very general conclu- 
sions. In his own work on return to civil life, the writer has 
found these conclusions of very practical value, and substan- 
tially correct. He confesses, for one, that his own previous 
opinions of the average intelligence of adults were very much 
distorted by limited experience and by failure adequately to 
weight the various experimental groups on which his previous 
conclusions had been based. The adult population of the 
State of New Jersey, for example, includes such heavy pro- 
portions of foreigners and unskilled laborers that the sup- 
posedly unselected groups previously observed by the writer 
now seem to have been very definitely selected in favor of 
superior intelligence on the basis of social standing. 

The Intelligence of Army Recruits 
The following table throws some light on the average intel- 
ligence of aduhs in terms of mental age, and compares native 
whites, f oreign-bom, and negroes : 
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Mental Ages or Asmt Rbcruits bt Nationalitt and Coumi 



Army Letter- 
Grade Ratii^ 


Equivalent 


Native 


Fordgn 


N^fro 


Army a$ 


Mental Age 


White 


bom 




Whole^ 






% 


% 


% 


% 


lUiterate 




17 


72 


62 


30 


D~ 


under 9.5 


5 


55 


39 


10 


D 


9.5-10.9 


15 


29 


28 


15 


C- 


11.0-12.9 


21 


8 


16 


20 


C 


13.0-14.9 


27 


7 


10 


25 


c+ 


15.0—16.4 


19 


1 


4 


17 


B 


16.5—17.9 


9 




2 


9 


A 


18.0-19.5 


4 




1 


4 


Total Number 




9,500 


3.700 


3,300 


1.500.000 


Lower quartOe 












(approz.) 
MedianMental 




11.5 


bek>w9.5 


below 9.5 


11.0 


age (approx.) 




13.5 


9.5 


10.0 


13.5 


Upper quartile 












(approx.) 




15.5 


10.5 


12.0 


15.5 



^Observe that the percentages in this column correspond doaely to the 
weighted average peroenti^^es obtained by combining the three preceding 
columns. 

The column headed "equivalent mental age," is obtained 
from the Basis for the Assignment of Letter Grades, Appen- 
dix A, of the Examiner's Guide for Psychological Examining 
in the Army (Page 91). The column headed " native whites " 
is based on approximately 9,500 men of the July draft at Camp 
Dix, New Jersey. The column headed " foreign-bom " is 
based on approximately 3,700 foreign-bom men chiefly south- 
em Italians, Russians and Russian Poles from the July draft 
at Camp Dix, New Jersey. The data of these two columns 
are embodied in a report from Lieut. Chas. L. Harlan to the 
Surgeon-General of the Army, entitled "A Study of Foreign- 
bora Men in the July Draft." The column headed " negro " 
is based upon approximately 3,300 negroes of the July draft 
at Camp Dix, New Jersey. The data of this column were 
obtained from a report to the Surgeon-General entitled "A 
Study of the Intelligence of Negro Recruits," by Lieut. Eldgar 
A. Doll with the assistance of Lieut. Arthur Komhauser. 
The column headed "Army as a whole " is obtained from data 
presented on page 5 of Army Mental Tests, Washington, 
D. C, November, 1918. 

The significance of the table is obvious. The median men- 
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tal ^gt of the total Army proves to be about 13.S years. This 
median presumably includes native whites, foreign-bom, and 
negroes. This median is not substantially different from diat 
obtained for native whites at Camp Dix, but as has been pre- 
viously mentioned, a median based on any one camp, or on 
less than many thousands of cases, is not entirely dependable. V 
At Camp Taylor, for example, there were very striking differ- 
ences between the average intelligence of regiments in the 
same brigade. We may, however, conclude with a fair degree 
of safety, that the average of totally unselected adults, re- 
gardless of nationality and color, is approximately 13 to 14 
years. 

The other columns of the table indicate striking differences 
between native whites, foreign-bom, and negroes. The aver- 
age mental age of native whites is 13.5 years, and of foreign- 
born and negroes is approximately 10 years. 

In considering the average mentality of foreign-bora it 
must be clearly understood that there is no implication that 
these foreign-bom adequately represent the average intelli- 
gence of their country. On the contrary it is commonly recog- 
nized that the type of immigrant received in this country since 
1900 is distinctly inferior to the tjrpe of immigrant previously 
received. In general tbe foreign-bom in this study are proln 
ably of inferior intelligence in their own countries. These 
foreign-bom do, however, adequately represent the foreigners 
now in this country between the ages of 20 and 30. 

The column of this table headed "Army letter-grade rating," 
combines both Alpha ratings and Beta ratings, that is, ratings 
of both literates and illiterates in group examinations. The 
first horizontal line of the table shows the percentage of 
illiteracy and indicates the close relationship between per cent 
of literacy and average intelligence. The foreign-bom and 
negroes were not penalized because of illiteracy, but rather had 
the advantage. There was a consensus of opinion among 
Army examiners that illiterate men of inferior intelligence 
tended to obtain higher ratings in the illiterate group examina- 
tion (Beta) than they would have obtained in the literate 
group examination (Alpha) had they been able to read and 
write. Compared with the native whites, therefore, the for- 
eign-bom and negroes have probably higher ratings than they 
deserved. On the other hand, it is of course conceivable that 
illiteracy tends to inhibit the full expression of the innate or 
potential intelligence of a man who has not had the advantage 
of schooling and an ordinary social environment. In opposi- 
tion to this, however, is the conviction of most examiners that 
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the n^oes uid foreign-bom were adequately rated, and if 
anything, rated higher than their true intelligence warranted. 
We come to the general conclusion, then, that the average 
intelligence of native whites is approximately 13 years, and 
that the average intelligence of foreigin-bom and negroes is 
approximately 10 years. It should l^ stated that there are 
stnking differences in the mentality of the different foreign- 
bom groups. The column of this table headed '' foreign- 
bom," is based chiefly upon southem Italians, Russians, and 
Russian-Poles, who constitute approximately 2,500 of the total 
3,700. It is not feasible at this time to consider the intelli- 
gence of the foreign-born in relation to specific nationality. 
This was an important contribution in the study made by 
Lieut. Harlan quoted above. Similarly among die negroes 
there were striking differences between the northem and 
southem negroes. The southem negroes were decidedly in- 
ferior to the northem negroes. The southem negro had an 
average mental age of about 9 years as compared with the 
average mental age of about 1 1 for northem negroes, as indi- 
cated in the study of negroes referred to above. 

The Age of Average Mental Arrest ^ 
The conclusions drawn from the preceding argument indi- 
cate that the average intelligence level of native white adults 
is approximately 13 years. This implies that growth in gen- 
eral intelligence is complete at the life age of 13 years, but this 
is not a necessary corollary. Such a conclusion cannot be 
made until successive examinations over a period of years on 
large numbers of cases, indicate at what age intelligence 
actually does cease to develop. It is conceivable that while the 
average intelligence level of adults is 13 years, this develop- 
ment may not have been fully attained until perhaps con- 
siderably after the life age of 13 years. There is indeed some 
reason to believe in a decreasing rate of intelligence growth, 
so that complete intelligence development may not be attained 
until an indefinite age. 

Some light is thrown on this problem by applying the Army 
Alpha test to juveniles. The writer has examin^ 514 chil- 
dren in the Franklin School, Trenton, N. J., with the Alpha 
group test. The median Alpha scores at each age are as 
follows : 

Median Age 9.5 10.5 11.5 12.5 13.5 14.5 15.5 
Median Score 26 37 61 81 85 80 88 
Na Cases 29 38 63 96 139 75 22 
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These figures indicate that the median intelligence of chil- 
dren above 12 years does not significantly exceed the median 
of 12-year-old children. There is a slight superiority of 13 
over 12, but after this there is a decrease. These children^ 
were examined in the eight grammar grades of a t3rpical aver- ' 
ajge public school. An analysis of the age and grade distribu- 
tion indicates that the children are typically average school 
children. The children in the 15-year-old group might, how- 
ever, be considered as slightly below average since they are 
slightly over age for the eighth grade. 

A similar study has been made of 480 delinquent boys at 
the State Home for Boys at Jamesburg, N. J. The median 
scores at each age are as follows : 



Median Age 


9.5 10.5 11.5 12.5 13.5 14.5 15.5 16 5 


Median Score 


6 8 15 20 31 34 30 29 


No. Cases 


15 33 51 82 91 102 73 28 



It will be observed that at each age these Alpha scores are 
markedly below the scores of the public school children of the 
same age. In fact, the average inferiority amounts to about 
3 years. The point at issue, however, is that here again aver- 
age development is complete at about 13 years, since the 
median scores of ages above 13 do not materially exceed those 
at 13, and in fact at some ages are below. This substantiates 
the result found in the public 'school and indicates that on the 
average, mental development is complete at about 13 years. 

It is not possible to cite any satisfactory statistics for any 
long period of years on the successive mental ages of normal 
children of adolescent age. The writer is, however, conduct- 
ing a study of approximately 250 feeble-minded children who 
have been re-tested over a period of at least four years each. 
It is too early to state final results, but as far as the study has 
progressed it is evident that the feeble-minded do not develop 
in intelligence after the life age of about 13 years. Contrary 
to previous beliefs, the age of final arrest is not a fimction of 
mental retardation, but is a fairly definite life age. Some 
feeble-minded of each grade contmue to develop in general 
intelligence, even though only slightly, up to about 13 years 
of age. 

From all of this evidence it appears that not only is 13 years 
the average intelligence age of adults, but the implication Is very 
strong that the full level of intelligence has been reached at 
the life age of approximately 13 years. This is not to be 
understood, however, as meaning that the entire mental 
growth is attained at that age. Maturity and experience must 
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certainly continue to effect changes in mentality after the age 
of 13 years, but the intelligence level, on the average, remains 
fixed. This does not mean that no one develops in intelli- 
gence after 13 years of age, or that no one has a mental age 
above 13 years. On the contrary, 50 per cent of these groups 
have mental ages above 13 years. It is not possible to say 
at this time which of the 50 per cent continue to develop, nor 
to what mental age they develop, nor at what life age limits 
mental growth ceases. The only permissible conclusion from l ^ 
these data is that on the Ofuerage, or for 50 per cent of pre- ^ 
sumably uhselected cases, intelligence growth is practically 
complete at 13 years. 

The writer wishes to emphasize that it would be fatal to 
both theory and practice to establish anything more than some 
new hypotheses on the data of this paper. Fifty per cent of 
these subjects do seem not to have developed intellectually 
after 13 years, but we cannot say much about the other 50 
per cent. Repeated individual examinations on a large scale 
are now our most pressing need. 

Intelligence and Feeble-mindedness 
There has been a tendency among clinical psychologists to 
lay increasing emphasis upon intelligence as a diagnostit 
symptom in determining feeble-mindedness. This emphasis is 
entirely proper but has been subject to a certain logical error. 
It was found by examining mental defectives in institutions 
that practically no feeble-minded "tested" higher than 13 
years in the Binet-Simon scale. It was then concluded both 
by implication and by actual statement, that all who tested 
under 13 years were feeble-minded. The upper limit of feeble- 
mindedness was tacitly assumed as the lower limit of nor- 
mality. Obviously this is the logical error of the converse. 
If all A is B, the only necessary consequence is, that some B 
is A. For example, if all negroes have mental ages below 15 
years it does not JFollow that all persons with mental au:es 
under 15 years are negroes. 

From practical experience, some clinicians have developed 
the concept of borderlinity. They recognize that there is a 
certain mental age zone within which the intelligence level 
alone breaks down as a diagnostic instrument. Within the 
limits of this zone some persons may be feeble-minded, some 
doubtful and some normal. In this connection the important 
contribution of the Army examining lies in the demonstration 
that persons with mental ages as low as even 7 or 8 years may 
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be socially normal, and that others with mental ages as high as 
13 or 14 years may be socially feeble-minded. 

The fundamental conception of feeble-nUndedness, of course, 
is one of social competence. A feeble-minded person is not a 
person of a particular mental age, but is one who by reason 
of inferior intelligence is incapable of supporting himself in- 
dependently of supervision in society, after he has reached the 
age of social responsibility or physical maturity. The mental 
age limits which were developed by clinicians in the Army on 
the basis of practical experience to designate this social re- 
sponsibility are somewhat as follows: 



Diagnosis 

Invariably feebleminded 
Usually feeble-minded 
Usually inferior normal 
Usually average normal 
Usually superior normal 



Native White Foreign-bom Colored 



Mental age 


Mental age 


Menttflace 


under 8 


under? 


under? 


8.0- 8.9 


7.0- 7 9 


7.0- 7.9 


9.0—10.9 


8.0—9.9 


8.0- 9.9 


11.0-13.9 


10.0-11.9 


10.0-11.9 


above 14.0 


above 12.0 


above 12,0 



In this table " invariably feeble-minded " means that persons 
of the intelligence level specified invariably proved to be feeble- 
minded when account was also taken of their social success, 
educability and general mental responsibility. " Usually 
feeble-minded," means that thpse persons within the mental 
age limits specified, usually, or in about 8 cases out of 10, 
proved to be feeble-minded when other factors are considered. 
In this group those who were not feeble-minded were ordi- 
narily subnormal or borderline cases. " Usually inferior nor- 
mal/* means that in about 8 cases out of 10 the individual 
within the mental age limits specified proved to be normal 
on the basis of social responsibility, literacy, educability and 
general mental qualities. Those not found to be normal were 
ordinarily high-grade feeble-minded or borderline cases. 

This grouping is not based on statistical or experimental 
study, but is an empirical classification developed from ex- 
tensive experience. In the Army it was found impossible to 
use intelligence alone with any degree of certainty as a diag- 
nostic method above intelligence level of about 8 years. Men- 
tal age was an invaluable diagnostic aid, however, and was 
perhaps the most important consideration next to a man's 
social history. In the Army it was found necessary to 
weigh social success very heavily in determining nor- 
mality or feeble-mindedness, and in the mental ex- 
aminations it was found important to take serious 
account of the quality of intelligence as well as the 
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level. Temperamental characteristics were also very impor- 
tant; prudence, forethoiu^t, judgment, reason and insight 
were (^>posed to mere veroal brightness. 

It will be noted that this classification uses lower mental age 
standards for foreign-bom and negroes than for native whites. 
This implies that the mental ages of foreign-bom, negroes, 
and native whites are of somewhat uneaual value in determin- 
ing social fitness. The mental ages of the foreign-bom and 
negroes seemed to be accurately measured, but due to some un- 
icnown psychological quality, the social value of mental age 
for fore^-bom and negroes was somewhat greater than for 
tne same age for native whites. 

This empirical conclusion suggests an important problem 
for experimental psychology. If the prognostic value of men- 
tal ages is not constant for the different races, psychology 
should certainly aim to discover the reason. It seemed de- 
sirable in the Army, and still seems desirable, for practical 
social purposes, to judge individuals according to standards 
for their race and social class, but this leads to some confu- 
sion in the diagnoses obtained. We have come so much to de- 
pend upon mental age as an expression of social fitness, that 
it will be somewhat difficult to employ multiple standards for 
different social groups. 

Average Intelligence and the I. Q, 
It is now the practice to use 16 years as the basis of calcu- 
lation for subjects whose life age is higher than 16. But if 
the implications here presented should be substantiated by 
further investigation, then it will become necessary to compute 
I. Q's. on a 13-year final age. This will make necessary a 
revision of previous work in which I. Q's. have been stated 
independently of age. Until the question of the average age 
of final mental development is settled, it should be urged up- 
on all advocates of the I. Q. always to accompany I. Q's. witfi 
the actual ages of the individuals tested. This is important 
anyway, since I. Q's. are not directly comparable independent 
of life ages any more than diagnoses by race and cLass are 
comparable independently of the race and class standard. An 
I. Q. of 50 where mental age is 8, cannot be directly compared 
with an I. Q. of 50 where the mental age is 4. 

It will be noted from the intelligence classification given 
above, that the I. Q. limits of feeble-mindedness are different 
from those advocated by Terman and his followers. Accord- 
ing to this table, the " invariably feeble-minded " are found to 
have I. Q's. under 50 as opposed to the I. Q. of 70 advocated 
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by Terman, and the " usually feeble-minded " are found to 
kave I. Qs. between 50 and 55, instead of between 70 and 75, 
as advocated by Terman. But, if the I. Q's. of the future come 
to be calculated on the basis of 13.5 years as the average adult 
intelligence, instead of 16 as now computed, then I. Q's. under 
60 will " invariably " denote feeble-mindedness, and I. Q's. 
under 64 to 70 will " usually " denote feeble-mindedness. Thus 
we might retain the present I. Q. diagnostic limits advocated 
by Terman, but they would have to be calculated on a different 
basis. 

Summary % 

1. The average mental age of adults is found to be approxi- 
mately 13 years instead of 16 as heretofore believed. 

2. The growth of general intelligence is found to be 
practically complete on the average by 13 years of age and is 
not on the average thereafter exceeded. This applies strictly 
to the level of intelligence or degree of brightness as opposed 
to intelligence pluis maturity, experience, and acquisitions. 

3. These conclusions are induced by four separate investi- 
gations on totally different types of subjects and from different 
points of view, namely: 

(a). The application of Alpha and Beta group intelligence 
tests to about 1,500,000 soldiers and recruits, where the aver- 
age mental age is found to be about 13 years. 

(b). The application of Alpha group intelligence tests to 
about 500 typical public school children, where the median 
scores of ages above 13 do not exceed the median for 13 years. 

(c). The application of Alpha group intelligence tests to 
about 500 juvenile delinquent boys, who are found to be of 
inferior intelligence but whose level of intelligence is fully 
attained by 13 years, on the average. 

(d). The repeated application of Binet intelligence tests 
to about 250 feeble-minded persons of wide ranges of life age 
and mental age, who individually may develop in intelligence 
up to a life age limit of 13 years and not thereafter. 

4. The conclusions are induced not merely by the empirical 
data of each separate investigation, but particularly by the 
consistency of agreement obtained from such strikingly dif- . 
ferent methods of approach. 

5. Striking differences are observed between the average 
levels of general intelligence of native whites, foreign-born, 
and negroes. Striking differences also are found for different 
social classes of native whites, different nationalities of 
foreign-bom, and different geographical groups of negroes. 
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6. A logical fallacy is exposed in the application of mental 
age limits to the diagnosis of normality and feeble-mindedness. 
The conception of borderlinity in relation to mental age is 
much extended. 

7. The calculation of intelligence quotients is found to be 
seriously disturbed by the uncertainty of the exact life age at 
which intelligence development is to be considered complete 
on the average. 

8. The standardization of mental age scores for ages above 
13 years by any method other than the percentile scores is not 
attempted, but is found to be impeded by the difficulty of ob- 
taining fully representative unselected groups of subjects out- 
side the grammar schools. 

Addendum 
It is now possible to strengthen the above argument still 
further. Nearly 550 delinquent youths and young men be- 
tween the ages of 16 and 29 inclusive, inmates of the New 
Jersey Reformatory, have recently been examined by Mr. J. 
\\'. Ellis, Assistant Psychologist to the N. J. Dept. of In- 
stitutions and Agencies, by means of the Army group test 
Alpha. The median Alpha scores at each age are as follows : 

Median age 16 17 18 19 20 21 22 23 24 25 26 27 28 29 Total 

Median score 59 62 5658 57 432869383960 98 2238 56 
No. cases 68 115 109 74 47 40 17 15 8 1111 4 8 5 541 

It is obvious from this table that there is 
crease in score with increase of age. Darin's 
years where there is a sufficiently large nnmbe { 
the median to be dependable (16 to 21) there is tiTTsi j 
variation in score except for an unaccountable drop al year 
21. The variations beyond year 21 may be accounted for on 
the basis of selection and the small number of cases. The fact 
that there is no consistent trend in these variations is, however, 
more significant than the variations themselves. The median 
score for the group represents a median mental age of ap-^" 
proximately 14 years. The group is a selected group on the 
basis of delinquency yet the average intelligence score is ^ 
nearly the same (slightly higher) than the average score of 
army recruits. Here again, however, we are not so much in- t- 
terested in the absolute score as the fact that there is no steady 
increase in score within increase in age. The intelligence 
levels above 16 are not superior to that of 16. It is probable, 
in the light of the public school and the Jamesburg Home 
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median scores that the 16-year median itself is perhaps not 
greater than it would have been had we had age groups ex- 
tending down to 13 or 14 years, but this is conjectural. 

This reformatory group supplies a fifth group and a new 
type of subject. The group covers the age-period between the 
public school group and the Army adult group. It fills the 
gap and gives a continous range of ages from 6 to 31 years. 
(The scores for years 6, 7 and 8 years have been omitted in 
this paper.) The continuity is, of course, broken by the 
variations in types of subjects, but an adequate basis of pre- 
liminary argument is afforded in the actual results. The new 

1^ data confirm the preceding argument that there is no increase 
in average general intelligence scores after a chronological 
age of presumably 13 or 14 years. Again we must insist that 

v/^ the scores of individuals range far above the 13-year level, 
with the presumption, however, that such scores represent 
superior deviations of the 13-year group and not age-increases 
as such. These superior scores also demonstrate that the 13- 
year level is not caused by limitations in the scale of tests 
itself, since individuals do score far beyond the median, thus 
proving the practical possibility of obtaining high scores if 
the capacity is present in the individual. 
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PSYCHOLOGICAL INVESTIGATION OF THE 
UKELIHOOD OF CONFUSION BETWEEN 
THE WORDS "COCA-COLA" AND 
" CHERO-COLA " ^ 



By Richard H. Paynter, Jr. 



This is a rqx>rt of a series of psychological experiments 
conducted to investigate the desceptive similarity or likelihood 
of confusion in visual appearance and in sound between the 
word trade-marks "Coca-Cola" and " Chero-Cola." The 
report also compares the likelihood of confusion between 
these words with that found to exist between word trade- 
marks that have been held in judicial proceedings to conflict 
and with others that have been held not to conflict. Two dis- 
tinct methods were employed in the investigation: the recog- 
nition or identification method, and the method of relative 
position. Four separate experiments were conducted, three 
with recognition and one with relative position. The recog- 
nition experiments were on confusion m visual appearance, 
and the relative position experiment was on confusion in 
sound. 

A. Visual Recognitive Confusion 
1. General Procedure and Technique, — The visual recog- 
nition or identification method was used because it involves 
the same mental process as that employed in daily life by the 
ordinary purchaser in buying a bottle of " Coca-Cola." In 
ordinary transactions of business where the article is sold 
across the counter, the purchaser examines the article to see 
if it is what he wants, or whether it is the same as that which 

^This study is a practical application of simple, straightforward 
psychological methods to an actual trade-mark case. The study was 
used in a case by The Coca-Cola Company in an opposition to the word 
" Chero-Cola." 

A more extensive investigation will appear in a forthcoming number 
of the Ardiives of Psychology, entitled **A Psychok)gical Study of 
Trade-mark Infringement" 

The writer expresses his deep gratitude to Professor Edward K. 
Strong, Jr.» of the Carnegie Institute for Technology, for the kind 
advice and help he has given in devising the experiments. 
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he has known or bought before. In deciding this matter, the 
purchaser is guided by the recognition or identification of the 
article as a whole, by certain features of it, or by a combina- 
tion of both these methods. It often happens, however, that 
a prospective purchaser has heard or seen only the word 
trade-mark, but not the article itself nor its container. In such 
cases he has to rely on his memory of just the word trade- 
mark in identifying the article. Likewise, the observer or 
individual in the experiment has to rely on his memory of the 
word trade-mark in order to tell whether or not what is before 
him now is the original trade-mark that he has just seen. The 
task assigned to him in the experiment was simply to indicate 
whether the words before him were just shown to him. 

The individual who submitted himself to do the recognition 
experiment was shown in the presentation 20 slips of paper 
on each of which was typewritten a word trade-mark, or a 
word trade-mark and the name of its commodity. These 
slips were presented one at a time at the uniform rate of one 
a second, by the writer who conducted all the experiments. 
Fifteen seconds after the exposure of the last slip in the 
presentation, the test set of slips was given to the observer. 
The test consisted of 40 slips, and from it the observer was 
asked to pick out those that he recognized as having just been 
seen and those that had not been seen. There were two varia- 
tions of the formation of the test, according to the problem 
of the experiment. When the problem was to determine the 
confusion between the words "Coca-Cola" and "Chero- 
Cola," " Coca-Cola " appeared in the presentation, whereas the 
imitation " Chero-Cola " appeared in the test together with 
19 trade-marks which were duplicates of 19 shown in the 
presentation, and 20 trade-marks which were new, i. e., they 
had not been shown in the presentation. When the problem 
was to compare the confusion of the imitation " Chero-Cola " 
with that of 9 other litigated imitations, "Coca-Cola" with 
their 9 originals appeared in the presentation, whereas " Chero- 
Cola " appeared in the test together with these 9* imitations, 
10 duplicates of the remaining 10 trade-marks shown in the 
presentation, and 20 new marks. In all these experiments 
" Coca-Cola " was shown in the presentation, but in the test 
where it did not appear the observer had to decide whether 
he had seen " Chero-Cola " which was not shown in the presen- 
tation. If he decided that he had seen the imitation he was 
confusing it with the imitation ; if he decided that he had not 
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seen the imitation he was not confusing it with the original.* 
Where the comparison was made with other litigated imita- 
tions the name of the article or commodity appeared with each 
trade-mark. There are two experiments where no compari- 
son was made, one showing the trade-marks without, and the 
other with, the names of their articles. It should be stated 
here, however, that although the words in the recognition ex- 
periments entered the mind of the observer through vision, 
not only did similarity in visual appearance, but also in sound, 
linguistic formation, and meaning or significance contribute 
to confusion. 

The following directions were given to each observer before 
he did the experiment : • 

** You are going to be shown one at a time a number of 
ordinary word trade-marks like * Uneeda,' * Garford,' and 
* Celluloid.* " (In the experiments where the trade-marks 
were used with the names of the articles, the observer was 
told of this and the examples were given as " Uneeda Biscuit," 
" Garford Automobile," etc.) " You are to read all the words 
on each slip of paper. Read them naturally as though you 
were reading an advertisement in a magazine or in a street 
car. Fifteen seconds after you have been shown the last mark, 
you will be g^ven a second set (the test) and asked to pick 
out those marks you have just seen in the presentation and 
those which you have not seen. You will be further asked to 
sort the marks into six piles, according to the degree of your 
confidence or certainty of your recognition of your marks. 
There are three degrees of certainty for the marks that are 
recognized as seen, and three similar degrees for those that 
are recognized as not seen. The three degrees are * absolutely 
certain,' * reasonably certain,' and a * faint idea.' " (After 
the observer has indicated his recognitions of all the marks 
in the test, he was asked how familiar he had been with the 
word "Coca-Cola"). "Would you say you had been 'per- 
fectly familiar,' * moderately familiar,' * just familiar,* or 

^ These two statements are not strictly accurate as they do not ta|cc 
into oonsideration the possibility of the presence of a small per cent, 
of observers who would not have been able to recognize "Coca-Cola," 
and in whom the perception of " Chero-Cola " would not recall " Coca- 
Cola.^* These observers would be guessing in recognizing, whether or 
hot they had seen " Chero-Cola," and would guess correctly ip.a^ut 50 
or 60 per cent, of the cases, thereby influencing equally the correct and 
incorrect recognitions of "Chero-Cola." As the 10 original trade- 
marks are approximately equally well recognized or familiar^ account- 
ing for this factor would introduce no significant change in the 'data 
or conclusions. 
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* unfamiliar ' with the word * Coca-Cola ' before you did this 
experiment?" 

Thus, three important facts were obtained from the experi- 
ment on each observer. The first fact was, whether or not he 
confused " Chero-Cola ' with " Coca-Cola." The second fact 
was, how confident he was that he was correct, or whether he 
was in doubt about his recognition. And the third fact was. 
how familiar he had been in daily life with the word " Coca- 
Cola." The question of visual confusion will be determined 
then by the data from these three sources of information. 

Each observer did only one experiment; and he did not do 
the same experiment more than once. The observer was not 
informed of the purpose of the experiment, nor did he know 
beforehand that an original trade-mark would be replaced by 
an imitation in the test. Furthermore, nothing was done to 
cause the observer to have any suspicion that a substitution 
had been made. The task set the observer in the experiment 
was not arduous, nor unpleasant. The experiment was done 
with the observer's own free will. No prize or reward was 
oflFered for the highest individual record. After each ob- 
server did the experiment the marks in both the presentation 
and test were thoroughly shuffled. As their positions in both 
series were thus determined by chance, no trade-mark was 
given undue prominence by its position. 

Ninety ordinary individuals were employed as observers 
in the recognition experiments. They represented more than 
60 diflFerent professions and occupations. Their ages were 
generally between 20 and 45. These individuals represent a 
random picking from ordinary individuals that resided in 
New York City, in the month of July, 1915. No effort was 
made to obtain exceptionally bright nor exceptionally dull 
individuals. 

All the trade-marks or trade-names studied in the experi- 
ments are used or have been used in commerce. When the 
names of the articles are used in the experiments in connec- 
tion with the trade-marks, they are the names of the same 
articles or commodities on which the trade-marks have actu- 
ally been used. The names of the goods represent many classes 
of goods of various descriptive properties. In the presenta- 
tion no trade-mark nor name of a commodity was the same 
as any other. The names of the commodities of the original 
trade-marks and their respective imitations were identical. 
The 20 new trade-marks and the names of their commodities 
were all different from the others, either in the test or in the 
presentation. 



Digitized by 



Google 



INVESTIGATION OP WORDS COCA-COLA AND CHERO-COLA 333 



The trade-marks and names of the commodities were all 
typewritten in the same kind of type. The experiments did 
not reproduce the style, coloring, or size of the trade marks 
or names of the commodities as used on the goods or in adver- 
tisements. The color of the ink used was black; and great 
care was taken in t)rpewriting the words to keep the black- 
ness of the ink the same for all the letters. All the words 
were typewritten on the same kind of white paper. Each slip 
of paper was two and three-quarters by four and one quarter 
inches in size. When the name of the commodity was used 
it appeared on the next line directly beneath the trade-mark. 
All the words appeared in the second horizontal quarter from 
the top of the slip. The four following reproductions are 
samples of some of the slips, which are identical with those 
actually used, with the exception of being reduced one-fourth. 



Originals 



Imitations 



Coca-Cola 



Chero-Cola 



Coca-Cola 
Soft Drink 



Chero-Cola 
Soft Drink 



Fig. I 

2. Results, a. Experiment in which Appeared One Imita- 
tion, the Names of the Articles not being Shown with the 
Trade-Marks. 

The word " Coca-Cola " and 19 other trade-marks appeared 
in the presentation series; the test series included the word 
"Chero-Cola," 19 duplicate trade-marks and 20 new trade- 
marks. 

Table I 

ThB NUMBEft AND PeR CeNT. OP 4O ObSEBVERS THAT CoNPUSED THE 

Word "CnEio-Qxji- wrrn "Coca-Cola" 



Number of Trade-Marks 

Observers Original Imitation 

40 Coca-Cola Chero-Cola 



Confused 
Number Per Cent 

II 2B 
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According to Table I, approximately one out of every three 
observers or 28 per cent, actually takes the word "Chero- 
Cola" to be "Coca-Cola," Of the 11 deceived by "Chero- 
Cola " 9 were " absolutely certain," 1 " reasonably certain/' 
and 1 had a " faint idea" that they had seen it. Thus most 
of the observers mistaken were quite confident that they 
were correct. Moreover, 9 of those confused by "Chero- 
Cola " were " perfectly familiar," and 2 " moderately 
familiar " with the original trade-mark " Coca-Cola." It is 
seen from this that observers even very familiar with the 
word " Coca-Cola " were deceived by the imitation " Chero- 
Cola." 

Throughout this investigation the figure representing the 
per cent, of individuals in a group confused by an imitation 
is not absolute. That is, it does not mean that just this per 
cent, of observers under the multitudinous varying conditions 
of everyday life will be confused. The percentage of con- 
fusion, is, however, a scientific measure depending on the 
observer's memory of the original mark and its similarity to 
the imitative. 

b. Experiment in which Appeared One Imitation, the 
Names of the Articles being Shown with the Trade-Marks. 

The problem of this experiment is to determine the likeli- 
hood of visual confusion between the phrases " Coca-Cola 
Soft Drink" and " Chero-Cola Soft Drmk." There is no 
other diflference in experimental technique between this ex- 
periment and the previous one, except that here each mark is 
used in connection with the name of its commodity. Table 
II. gives the number and per cent, of 25 observers that con- 
fused the words " Chero-Cola Soft Drink " with " Coca-Cola 
Soft Drink." 

Table II 

Th£ Number and Per Cent, of 25 Observers that Confused the 

Word " Chero-Cola " with " Coca-Cola," when Applied to 

THE Words " Soft Drink " 

Number of Trade-Mark Name of Confused 

Observers Original Imitation Article Number Per Cent 
25 Coca-Cola Chero-Cola Soft Drink 17 68 

Seventeen or 68 per cent, of the group confused "Chero- 
Cola Soft Drink " with " Coca-Cola Soft Drink." When used 
in connection with the words " Soft Drink " 2 out of every 
3 observers take "Chero-Cola" for." Coca-Cola." Of the 17 
deceived by "Chero-Cola" 12 were "absolutely certain," 2 
" reasonably certain," and 3 had a " faint idea " that they had 
seen it. Moreover, 14 of those confused were "perfectly 
familiar," 2 " moderately familiar," and 1 " just familiar " with 
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the original mark " Coca-Cola." As in Table I. the observers 
in Table II. were nearly all quite confident of their false recog- 
nitions of the imitation, and also very familiar with the 
" Coca-Cola." 

The figures in Table II. show about two and one-half times 
as much confusion as do those in Table I. It is the addition 
of the name of the commodity to both the original and imita- 
tive marks that furnishes an explanation for this increase. As 
the observers in the present experiment had to read in the 
presentation the words " Coca-Cola Soft Drink " in the same 
time that those in the previous experiment had to read just 
the word " Coca-Cola," the word " Coca-Cola " in the former 
not being so well perceived, was not so firmly established as 
in the minds of those of the latter group. Having to contend 
with a weaker mental impression of " Coca-Cola " confusion 
with " Chero-Cola " was more likely. Furthermore, as the 
two perceptions " Coca-Cola Soft Drink " and " Chero-Cola 
Soft Drink " are relatively more similar than the two percep- 
tions " Coca-Cola " and " Chero-Cola," confusion between the 
former is hence greater. 

c. Experiment in which Appeared 10 Imitations, the Names 
of the Articles being shown with the Trade-Marks. 

The problem in the present experiment is to compare the 
likelihood of visual confusion between the words " Coca-Cola 
Soft Drink " and " Chero-Cola Soft Drink," with the likeli- 
hood of visual confusion found to exist between other pairs of 
similar word trade-marks that had been the subject of actual 
adjudication of infringement or non-infringement. Nine legal 
decisions • on the similarity of word trade-marks were selected 

3 Holeproof, Knotair, hosiery ; Holeproof Hosiery Co. v. Wallach 
Bros., igo Fed. Rep. 6o6 (U. S. Cir. Ct). 

Grape-Nuts, Grain-Hearts, cereal food; Postum Cereal Food Co., 
Ltd., V. American Health Food Co., 119 Fed. Rep. 848 (U. S. Cir. Ct. 
of App.). 

Cascarets, Castorets, remedy; Sterling Remedy Co. v. Spermine 
Medical Co., 112 Fed. Rep. 1000 (U. S. Cir. Ct. of App.). 

Gold Dust, Gold Drop, washing powder; N. K. Fairbank Co. v. 
Luckel. King & Cake Soap Co., 102 Fed. Rep. 327 (U. S. Cir. Ct. of 
App.). 

Listerine, Listogen, antiseptic; Lambert Pharmacal Co. v. Bolton 
Chemical Corporation, 5 Trade-Mark Rep. 38 (U. S. Dist. Ct.). 

Mother's, Grand-Ma's, waxing pad; E. A. Bromund Co. v. Columbia 
Wax Products Co., 200 O. G. 1115 (Ct. of App., D. C). 

Sozodont, Kalodont, tooth paste; K. K. Landespriv et al. v. Hall & 
Ruckel. 19; I C. D. 329, 165 O. G. 732 (Ct. of App., D. C). 

Green River, Green Ribbon, whisky; Lang v. Green River Distilling 
Co., 1909 C. D. 476, 148 O. G. 280, 33 App. D. C. 506 (Ct. of App. D. C). 

Club, Chancelor Qub, cocktails; In re S. C. Herbst Importing Co., 
1908 C D. 383. 134 O. G. 1565, 30 App. D. C 297 (Ct. of App. DC). 
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for comparison. Five were adjudications of infringement, in 
which the use of the imitative marks was enjoined, and four 
were adjudications of non-infringements in which injunctions 
against the use of the alleged illegal imitations were refused. 
In selecting these decisions two principles were followed; 
first, that the original mark in the decision should be widely 
known ; and second, that no other circumstance or reason than 
that of similarity between the word trade-marks should have 
determined the point of infringement or non-infringement in 
the decision. 

The first principle was set up because the word " Coca- 
Cola " is widely known, and is pretty familiar to a great many 
individuals in New York City, where all the experiments were 
conducted. And furthermore, because an imitation would 
probably cause less confusion in the case of a more familiar 
original mark than in the case of a less familiar original, a 
comparison of the confusion caused by their respective imita- 
tions would unfairly show relatively greater confusion for 
the imitation of the less familiar original. Thus, the confusion 
brought about by the imitation of " Coca-Cola " will be prop- 
erly compared with the confusion brought about by the in- 
fringing and non-infringing imitations, if their originals are 
approximately as well-known as " Coca-Cola." It should be 
stated here, however, that not all the decisions studied have 
originals as well known-as " Coca-Cola." These marks will 
receive separate treatment. 

The second principle was set up for two reasons. The first 
was that, the experiment measures visual confusion of just 
word trade-marks. The second was that, if various .factors 
such as the question of the validity of the trade-marks, un- 
clean hands, similarity of the type, color, or other features 
of the label or package entered in the decisions and operated 
to influence the point of infringement or non-infringement, 
we could not properly compare the experimental results of 
these complicated decisions with each other, nor with the 
simple decisions of confusion of just the word trade-marks, 
nor with " Chero-Cola." It is obvious that decisions deter- 
mined by confusion of word trade-marks plus certain other 
reasons are not in the same legal nor psychological categories 
as those determined simply by the confusion of just the word 
trade-marks. The decisions in the former categories could 
not be properly given as authorities governing those in the 
latter, or vice versa. 

Notwithstanding the fact that some selection has been made 
in obtaining these decisions, no selection was made to obtain 
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decisions whose trade-marks seemed to have only little likeli- 
hood of confusion or |ess than that of the imitation of ** Coca- 
Cola." That is, no judgment was exercised to set forth as 
very great the confusion caused by " Chero-Cola " by contrast 
with imitations that might be expected to show only a slight de- 
gree of confusion. In this respect the decisions represent a 
diance or random sampling of infringements and non-infringe- 
ments, affording thereby a fair comparison of "Chero- 
Cola" with infringements and non-infringements of 
well-known original trade-marks in general. In this 
respect the experimental metho4 gives a scientific com- 
parison, not one biased in advance to argue a decision of in- 
fringement against the word " Chero-Cola." 

This experiment is the same as the previous one, except 
for the presence of 10 imitations in the test series instead of 
one. The words "Chero-Cola Soft Drink" were in the test 
series together with 9 other imitations, 10 duplicates, and 20 
new trade-marks. 

TABLE III 

The Number and Per Cent op Observers Confused by the Word 
"Chero-Cola," Each op the Five Infringements^ and Pour 
Non-infringements, When Applied to the Names op Their 
Articles 





Trade-Marks 


Name of 


Confused 


Decisi 


on Original 


Imitative 


ArUde 


No. 


PC, 


N 


Sozodont 


Kakxkmt 


Tooth Piwtc 


24 


48 


I 


Green River 


Green Ribbon 


Whisky 


23 


46 


N 


Mother's 


Grand-Ma's 


Waxing Pad 


20 


40 




Coca-X^fla 


Ckero-Cola 


Soft Drink 


10 


S" 


I 


Club 


ChanceUorClub Cocktails 


17 


I 


Listerine 


Listogen 


Antiseptic . 
Remedy 


16 


32 


I 


Cascarets 


Castorets 


14 


28 


I 


GoklDust 


GokiDrop 


Washing Powder 


13 


26 


N 


Holeproof 


Knotair 


Hosiery 


12 


24 


N 


Grape-Nuts 


Grain-Hearts 


Cereal Pood 


9 


18 



*Thi8 percentage is reckoned on the basis of 25 observers in the group; 
all the other percentages are reckoned on the basis of 50 in the group. 

Table III. gives the number and per cent, of observers con- 
fused by each of the imitations. The first column in the table 
shows whether the imitation in the decision was held to be an 
infringement (I) or a non-infringement (N). The second 
column gives the original trade-mark in the decision; the 
third the imitative trade-mark ; and the fourth the name of the 
commodity to which both the original and imitative trade- 
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marks were applied. The fifth column gives the number of ob- 
servers confused; the sixth and the last per cent. ccMifused. 
The marks are arranged in an order of confusion from most to 
least. 

" Sozodont — Kalodont," a non-infringement case, is the 
most confusing pair, 24 observers or 48 per cent, of the en- 
tire group were confused. " Green River — Green Ribbon/' 
an infringement, stands second highest with 46 per cent, con- 
fused. " Coca-Cola — Chero-Cola " ties with a non-infringe- 
ment, " Mother's — Grand-Ma's," for the third most confusing 
position with 40 per cent, eonfused. The differences between 
these four pairs of marks are not large. Of the 10 observers 
confused by ** Chero-Cola " 9 were " absolutely certain," and 
1 had a " faint idea " that they had seen it. Nine of those 
confused by " Chero-Cola " were " perfectly familiar," and 1 
" moderately familiar " with the word " Coca-Cola." As in 
the two previous experiments most of the observers confused 
were very familiar with the word " Coca-Cola," and they were 
scarcely even doubtful in their errors. Two imitations are 
more confusing than " Chero-Cola," one of these is a non- 
infringing imitation and the other an infringing. Four in- 
fringements and two non-infringements have lower scores than 
"Coca-Cola — Chero-Cola." It is 6 per cent, lower than the 
most confusing infringement " Green River — Green Ribbon ;" 
and 14 per cent, higher than the least confusing infringement 
" Gold Dust — Gold Drop." It is 8 per cent, lower than the 
most confusing non-infringement " Sozodont — Kalodont ; " 
and 22 per cent, higher than the lowest non-infringement 
" Grape-Nuts — Grain-Hearts." 

The original marks in the table that are about as well- 
known in New York City as " Coco-Cola " are perhaps " Gold 
Dust," "Grape-Nuts," and "Cascarets." The remaining 
original marks, with the exception of " Sozodont," contain 
ordinary words which are met with frequently enough in 
daily life to be perhaps as familiar as the three above marks. 
It seems that the combination of the two ordinary words in 
" Holeproof " puts it also under the latter class of marks. Let 
us now compare the scores of the imitations of these two 
classes with the score of " Chero-Cola." It is more confusing 
than the imitation of any of the most widely known original 
marks. Two of these imitations are infringements and one 
a non-infringement. In order of amount of confusion these 
marks are: 
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CocthCoh . Chero-Cola 40 per omt. 

CaacareU Castorets & 

GoidDaBt Gold Drop 26 " " 

Grape-NulB Grain-Hearts 18 

" Coca-Cola — Chcro-Cola " has confused 12 per cent, more 
observers than "Cascarets — Castorets;" 14 per cent more 
than " Gold Dust — Gold Drop ; " and 22 per cent, more than 
" Grape-Nuts — Grain Hearts." Of the less well-known 
origiiud marks one non-infringement " Sozodont — Kalodont," 
and one infringement " Green River— Green Ribbon " are 
more confusing. " Mother's— Grand-Ma's," a non-infringe- 
ment ties with " Coca-Cola — Chero-Cola," and all the rest are 
less confusing than it. 

It will be observed that in Table III " Chero-Cola " shows 
less confusion than in Table II. In both experiments the 
marks were used in connection with the name of the com- 
modity. In Table III the per cent, confused is 40, and in 
Table II, 68 per cent., the difference being 28 per cent. The 
reason for the decrease in Table III was that " Chero-Cola " 
appeared in the test together with 9 other imitations. The 
fact that the observer was usually confronted with several 
imitations before the imitation of " Coco-Cola " appeared, was 
in itself a kind of fore-knowledge and warning to beware of 
imitaticMis. In the experiment of Table II. the presence of 
one imitation among 39 different trade-marks in the test, 19 
being duplicates of what they had seen and 20 new, would 
find the observer not expecting to be fooled by an imitation. 
In the experiment of Table III the presence of 10 imitations 
in the test together with 10 duplicate and 20 new marks would, 
on the contrary, act as a warning to be more cautious, wary, 
and careful in recognizing all marks. The natural result fol- 
lowed this condition ; that is, there was a cutting down of the 
confusion caused by "Chero-Cola." 

TABLE IV 

Thb Average Per Cent, of Observers Confused by the Word 
"Chero<^ola," the Five Infringements, and Four Non-In- 
fringements, When Appued to the Names of Their Articles 

Number of Confused 

Decisions Decision Av. P.C. 

Coc(hCola—CkeT(hCola ao. 

5 Infringement 33.2 

4 Non-infringement 32.5 
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If we compute the average percentages of the five infring- 
ing marks, and of the four non-infringing marks, as in TaUe 
IV, we find that the score of " Coca-Cola— Chero-Cola " is 
higher than either average. It is about 7 per cent higher. The 
average for the infringements is 33.2 per cent., and for the 
non-infringements 32.5 per cent. The average of the infringe- 
ments is only 0.7 per cent, higher than the average of the non- 
infringements. 

The most important characteristic of this difference is its 
small amount. On the other hand, "(Jreen River— Green 
Ribbon" and "Gold Dust— Gold Drop" is 20 per cent; and 
the largest difference between two non-infringements, " Sozo- 
dont — Kalodont " and " Grape-Nuts — Grain-Hearts " is 30 per 
cent. Returning for a moment to Table III, two non-infringe- 
ments, three if we include " Coca-Cola— Ghero-Gola," arc 
more confusing than four infringements. The most confus- 
ing imitation is a non-infringement; and three of the four 
most confusing imitations are non-infringements, including 
"Coca-Cola — Chero-Cola." The least two confusing imita- 
tions are non-infringements. The differences within both 
classes of decisions so enormously outweigh the difference be- 
tween the classes, that for practical purposes the difference 
in confusion between the infringing and non-infringing imita- 
tions may be disregarded. 

Therefore, these decisions are not entirely reliable or con- 
sistent. The experiment, presenting conditions no more diffi- 
cult or essentially different from those in daily life, finds that 
there is a likelihood of confusion with all non-infringing imita- 
tions which the courts held to show no confusion. 

d. Duplicate and New Trade-Marks. By calculating how 
well the duplicate and new trade-marks were recognized, the 
difficulty of the task set the observer may be shown. If the 
observer recognizes correctly all the duplicates and new trade- 
marks, he would then obtain for them 100 per cent of correct 
recognitions, or a perfect score. A score of 50 per cent, of 
correct recognitions may indicate that the experiment is ex- 
ceedingly difficult or that the observer was simply guessing, 
in either case meaning zero or no memory of the duplicate 
shown in the presentation. By pure chance alone it would be 
possible to obtain this score. An average of 75 per cent, of 
correct recognitions would then stand midway between zero 
ability to recognize and just a perfect score; an average of 85 
per cent, would stand seven-tenths of the distance to the latter. 
The other intervening scores can likewise be judged as to their 
relative difficulty. So, irrespective of the observer's recog- 
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liitions of the imitations, the diflkulty of the experimental 
eonditions may be shown by calculating the per cent, of cor- 
rect recognitions of the duplicate and new trade-marks. 

As is shown in Table V, the duplicates have a score of 80 
per cent, and the new trade-marks a score of 94 per cent. 

TABLE V 
The Avbragb Pbr Cent, or Observers that Correctly Rbcognizbd 

THE DUPUCATE AND NEW MARKS, WriH OnE IiOTATION WrTBOUT 

THE Name or the Article 

Number of Marks Kind of Mark Average Per 

Cent 

19 Duplkate 80 

20 New 94 
Average 87 

It is thus easier to tell the marks that have not been seen 
before than those that have. The final average 87 per cent, 
represents the difficulty of the task set the observers. That is, 
excluding the results of the imitation, the average per cent. 
of correct rec(^[nitions of all the other marks is 87 per cent. 
The task was perhaps not more difficult than that which the 
prevailing conditions in daily life would offer, nor so easy that 
It could be reacted to without error. 

TABLE VI 
The Average Per Cent, op Observers That Correctly Recognized 

THE DUPUCATE AND NEW MARKS, WTTH ONE IMTTATION WTTH THE 

Name op the Article 

Number of Marks Kind of Mark Average 

PftrCent. 

19 Duplicate 66 

20 New 91 
Average 79 

Table VI presents the results of the duplicate and new 
trade-marks in the experiment in which one imitation ap- 
peared, and in which the trade-marks were used with the 
names of their commodities. The duplicates have a score of 
66 per cent., and the new trade-marks a score of 91 per cent. 
In Table VI, as also in the preceding table, the average per 
cent, of the new trade-marks is higher than that of the dupli- 
cates. There is, however, in Table VI a lower score for the 
duplicates than in Table V; those for the new trade-marks 
are about the same. 
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This decrease in per cent, of correct recognitions for the 
duplicates with the name of the article is explained by the 
fact that in the same length of exposure more material in die 
presentation had to he taken in than when the trade-mark 
alone was shown. A weaker mental impression for the dupli- 
cates in Table VI thus caused a drop in the per cent of cor- 
rect recognitions. But, adding the name of the article to the 
new trade-marks made just a slightly lower change in ability 
to discriminate them. We have already seen above In Table 
II that the relatively shorter time to receive the impression of 
the original with the name of the commodity aided in causing 
more confusion than did the original trade-mark without it, 
as in Table I. The final average in Table VI is 79 per cent. 
Although it is 8 per cent, lower than the final average in Table 
V, the task is still of fair difficulty. 

TABLE VII 
The Average Per Cent, of Observers That Correctly Recognized 

THE DUPUCATE and NBW MaRKS, WTTH 10 IlOTATIONS WITH THE 

Name op the Article 

Number of Marks Kind of Mark Average 

Percent. 

10 DupUcate 68 

20 New 94 

Average^ 85 

Table VII gives the average per cent, of correct recogni- 
tions of the duplicate and new trade-marks in the experiment 
in which 10 imitations appeared, and in which the trade- 
marks were used with the names of their commodity. The 
duplicates have a score of 68 per cent., and the new trade- 
marks a score of 94 per cent. As in Tables V and VI the 
average of the new trade-marks is higher than the average of 
the duplicates. The scores in Tables VI and VII are for both 
kinds of marks about the same. The final avera^ 85 per 
cent, in Table VII represents the difiiculty of the task. 
B. Sound Confusion Measured by Relative Position 
1. General Procedure and Technique. The method of rela- 
tive position was used to compare the likelihood of confusion 
in sotmd between the words " Coca-Cola " and " Chero-Cola ** 
with that between the litigated trade-marks of the previous 

«Thi8 average was obtained by dividing the sum of the 90 aqparate 
scores by 90: it is slightly hi^ier than the average obtained by dividing 
the sum of the average of the duplicate and new scores by 2. 



Digitized by 



Google 



INVESHGATION OF WORDS COCA-C(»Jl AND CHERO-COLA 343 

experiment. This method does not state "how many" are 
confused in sound by die various imitations/ but it does give 
a measure of their relative differences in sound confusion. It 
required the observer to arrange the 10 pairs of litigated trade- 
marks in a list according to the amount or magnitude of con- 
fusion that the imitation is likely to cause. Any pair is then 
measured by its position in the list. In the comparison of 
" Chero-Cola " with the nine imitations, and the psychological 
criticism of their legal decisions it is recognized that the deci- 
sions were not rendered entirely on sound confusion. 

Measurement by relative position was adopted: first, be- 
cause it is a different method from that used m the previous 
experiment ; second, because there is a certain analogv between 
the mental processes of the observer judging relative (ufferences 
and the mental processes in the minds of the court judging 
the question of infringement or non-infringement; and third, 
because confusion between the words " Coca-G>la '* and 
** Chero-Cola " is especially likely to occur under certain 
actual business conditions in respect to their sounds. 

As regards the first point, it would obviously be of much 
importance if a method different from that employed in visual 
recognitive confusion should show that confusion in sound 
between the words " Coca-Cola " and " CherorCola " was 
above that of the average of the infringing and non-infringing 
marks. Confirmation of greater likelihoc^ of confusion than 
infringements and non-infringements by two different methods 
is certainly significant. 

As regards the second point, the mental processes of the 
observer comparing relative differences in sound confusion are 
essentially very similar to those in the minds of judges com- 
paring the sound confusion of a pair of trade-marks in a case 
in court with that of trade-marks adjudicated infringement 
and non-infringement. Although there are resemblances be- 
tween the mental conditions that give the experimental data 
and those that g^ve the legal decisions, there are differences 
between this experimental method and the legal procedure 
that have greater significance. With measurement by relative 
position the accuracy or mathematical validity is higher. In 
employing a far greater number of observers the arrangement 
is much less likely to be the result of chance bias of a few in- 
dividuals. In the average of a large number of judgments a 
chance bias in any one direction is cancelled, and the result 
represents the general tendency of all the observers. 

Furthermore, the observers are entirely disinterested in the 
outcome of the experiment. They do not know which trade- 
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marks have been adjudicated infringement or non-infring^ 
ment, nor that any pair of trade-marks is being especially in- 
vestigated. Not knowing that the experiment is beii^ cbnr 
duct^ for a pending case the judgments of the observers arc 
consequently without prejudice to either plaintiff or defend- 
ant. On the other hand, with legal procedure not more than 
a few judges pass on the decision; and their judgments tend 
to some extent to be influenced by the abilities of contending 
counsels to magnify the differences and increase the similari- 
ties of the trade-marks. Measurement by relative position 
gives an exact measure, whereas a judicial decision throws a 
case into one or two categories, ill-defined and without quanti- 
tative significance. It is thus clear that this experimental 
method is far superior to the present legal procedure. 

As regards the last point, the probability of confusion in 
sound or pronunciation between the words " Coca-Cola " and 
" Chero-Cola " is considered because it is in this respect th^ 
a purchaser asking for a glass of " Coca-Cola " from the dis- 
penser of the drink at the fountain is likely to be fooled. The 
purchaser under these conditions does not usually see the 
label on the bottle or its crown, and and he can not identify 
the drink by its trade-mark. Assuming that the dispenser is 
acting honestly in listening to his customer's request, and in 
fulfilling what he believes to be that request, confusion be- 
tween the words "Coca-Cola" and "Chero-Cola" is most 
likely in sound or pronunciation alone. 

Each observer was given an envelope and a sheet of direc- 
tions. Enclosed in the envelope were 10 slips of white paper, 
on each of which appeared two trade-marks. The slips of 
paper were the same size as those of the previous experiments ; 
and the trade-marks were all typewritten in black ink. The 
name of the article or commodity did not appear with the 
trade-mark. The following reproduction is a sample oi one 
of the slips and is identical with that actually used. 



Coca-Cola 
Chero-Cola 



Fig. 2 
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The directions were as follows : 

** Please arrange in serial order as well as you can the en- 
closed slips of paper according to the following instructions. 

'* Each slip contains two trade-marks of a common article. 
The upper is the original trade-mark, and the lower is the imi- 
tation of it. 

"The different pairs of trade-marks on the different slips 
vary in their likelihood of confusion, or in their deceptive 
similarity, or in the likelihood that the imitation trade-mark 
will be mistaken for the original. This confusion may be due 
to the appearance of the trade-niarks, their sound, their tin- 
guistic formation, their meaning or significance, or any com- 
bination of these four factors. Neglect, however, all of these 
four factors except that of sound, 

"Arrange the slips according to the likelihood of confusion 
in just the sound of the trade-marks : Put on the top of the 
pile the slip containing the imitation which shows the greatest 
likelihood of confusion in sound and on the bottom the slip 
containing the imitation which shows the least likelihood of 
confusion in sound. Between the top slip and the bottom put 
in order those slips containing imitations which show inter- 
vening degrees of likelihood of confusion in soimd. 

" In arranging the slips consider the ttade-marks as if you 
have had no previous experience with them." 

In addition, the observer was told that there was no time 
limit, and that he could take as long as he wished to make 
the arrangement, and further that he was allowed to rearrange 
the order until it satisfied him. To do the experiment usually 
required about five minutes. No information was given as to 
the purpose of the experiment. 

Fifty observers assisted in the task of judging the trade- 
marks. They were mostly students of psychology at Columbia 
University, during the month of October, 191 ST Some were 
undergraduates studying psychology, and some were graduate 
students with special training in it, and a few were assistants 
and instructors of psychology. Only four observers had not 
gone to college, but all had been acquainted with psycho- 
logical experiments. No observer that took part in any of the 
recognition experiments acted again in this experiment. 

2. Results, Table VIII gives the grades and probable 
errors of the word " Chero-Cola," each of the five infringing, 
and four non-infringing imitations. The first column in the 
table shows whether the imitation in the decision was held to 
be an infringement (I) or a noninfringement (N). The sec- 
ond column gives the original trade-mark in the decision ; and 
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the third the imitative. The fourth coluinii gives the grade; 
and the fifth and last the probable error of the grade. The 
marks are arranged in an order of probable confusion from 
most to least. The pair of trade-marks which received the 
smallest average was judged to have the greatest likelihood of 
confusion in sound ; the pair which obtained the largest aver- 
age was judged to have the least likelihood of confusion in 
sound. 

TABLE VIII 

The GkADES and Probable Errors op the Word "Chero-Cola»"^ 
Each op the Five Infringements, and Four N(»f-lNFRiNGEifBNts 

Trade-Mark 
Decision Original Imitative 

Castorets 

Green Ribbon 

Chero-Cola 

Listogen 

Kadodont 

Gold Drop 

Grain-Hearts 

Chancellor Club 

Grand-Ma's 

Knotair 

" Cascarets — Castorets," an infringement, has been selteted 
out of the 10 pairs of trade-marks as being the most confus- 
ing. It was placed in the first position by 42 observers, and 
in the second by 8. Its average grade or position is 1.2. 
" Green River — Green Ribbon " stands second with a grade 
of 3.3. "Coca-Cola — Chero-Cola" with a grade of 3.6 is 
nearly tied by an infringement, "Listerine — ^Listogen" with 
a grade of 3.7 for the third most confusing position. The 
grade of " Coca.-Cola — Chero-Cola " is 0.3 lower than that of 
" Green River — Green Ribbon," and 0.1 higher than that of 
** Listerine — Listogen." These differences are not large. The 
grade of " Coca-Cola — Chero-Cola " is 2.4 lower than the 
grade of the most confusing infringement "Cascarets — Cas- 
torets ; " and it is 4.2 higher than that of the least confusing 
infringement " Club— Chancellor Club." It is 1.5 higher than 
the most confusing non-infringement "Sozodont — Ks^o- 
dont ; " and it is 5.9 higher than the grade of the least confus- 
ing non-infringement " Holeproof — Knotair." The arrange- 
ment shows that " Coca-Cola — Chero-Cola " is about equally 
confusing with one infringement, less confusing than two in- 
fringements, and more confusing than two infringements and 
all four non-infringements. 



I 


Caacarete 


I 


Green River 




Coca-Cola 


1 


ttsterine 


N 


Sooodont 


I 


Gold Dust 


N 

I 


Grape-Nuts 
Club 


N 


Mother's 


N 


Hdeproof 



Av. 


P.E. 


1.2 


.03 


3.3 


.13 


M 


% 


5.1 


.20 


5.2 


.12 


7.0 


.13 


7.8 


.11 


8.6 


.09 


9.5 


.06 
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A consideration of the probable errors will show that the 
grades of confusion of the different pairs of trade-marks have 
a high degree of validity. Moreover, the validi^ itself of 
the order can be measured. The probable error ot the grade 
1.2 is 0.03. It must, however, be remembered that the chances 
of the true grade being far outside this range decrease very 
rapidly. The possibility that the grade 1.2 of "Cascarets — 
Castorets ** is due to chance is entirely negligible. Although 
all the remaining probable errors are somewhat larger, they 
indicate a high degree of validity of the average grades. The 
larger probable errors indicate that the order is less certain, 
and the difference in confusion between one pair of trade- 
marks and the next on the list is less. The probable error of 
the grade 3.6 of ** Coca-Cola — Chero-Cola " is 0.17, or the 
chances are even that this grade is correct within about one- 
fifth of a unit. 

The probable error of the difference 0.3 between the grade 
3.6 of " Coca-Cola — Chero-Cola " and the next higher grade 
of " Green River — Green Ribbon " will show the chances that 
" Coca-Cola — Chero-Cola " deserves a grade as high as that 
of " Green River — Green Ribbon." The probable error of the 
difference 0.3 is 0.21. As the difference 0.3 is about 1.4 times 
greater than the probable error of the difference 0.21, the 
chances are about 3 to 2 that " Coca-Cola — Chero-Cola " does 
not deserve a grade as high as that of "Green River — Green 
Ribbon." As the difference 0.1 between the grade of " Coca- 
Cola— Chero-Cola " and the next lower grade of " Listerine — 
Listogen " is covered by the probable errors of the grades, 
the chances are nearly even that " Listerine — Listogen " de- 
serves a grade as high as that of " Coca-Cola — Chero-Cola." 
The probable error of the difference 1.5 between the grade of 
" Coca-Cola — Chero-Cola " and the second lower grade of 
" Sozodont — Kalodont " is 0.26. As the difference 1.5 is 
about 5.8 times greater than the probable error of the differ- 
ence 0.26, the chances are over 10,000 to 1 that " Coca-Cola — 
Chero-Cola" does not deserve a grade as low as that of 
" Sozodont — Kalodont." Therefore, the chances are about 
3 to 2 that ' * Coca-Cola — Chero-Cola " does not deserve a 
grade as high as that of " Green River — Green Ribbon ; " the 
chances are nearly even that " Listerine — Listogen " deserves 
a grade as high as that of " Coca-Cola — Chero-Cola; "and the 
chances are over 10,000 to 1 that " Coca-Cola — Chero-Cola " 
does not deserve a grade as low as that of " Sozodont — 
Kalodont." 

Of the very well-known original trade-marks " Cascarets — 
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Castorets" alone stands higher than '' Coca-Gda-^Chero- 
Cola," and "Gold Dust— Gold Drop" and "Grape-Nuts— 
Grain-Hearts" are both lower. Of the less ¥^-known 
original trade-marks "Green River — Green Ribbon" stands 
higher than " Coca-Cola — Chero-Cola," " Listerine — ^Listo- 
gen " about the same, and all the rest lower. In this relative 
position experiment the comparison between these two classes 
of trade-marks is not really necessary as the instructions re- 

auired the observer to disregard the factor of familiarity with 
lie trade-marks. In only three cases did the observer report 
any difficulty in so doing it. 

TABLE IX 

The Average Gmdes and Probable Errors op the Word **Chero- 
Cola," the Five Infringements, and Four Non-Infringements 

Number of 
Decisions Decision Av. P. E. 

Coca-Coia—CkeroOAa 3^ .17 

5 Infringement 4.2 .12 

4 Non-infringement 7.6 .11 

Table IX gives the average grades of " Coca-Cola — Chero- 
Cola " of the five infringements, and four non-infringements. 
" Coca-Cola — Chero Cola " has a higher rank than both the 
average grades of the infringements, and the average grades 
of the non-infringements. It is 0.6 higher than the average 
of the infringements, and 4.0 higher tlmn the average of the 
non-infringements. The average of the infringements is 4.2, 
and that of the non-infringements 7.6; their probable errors 
are 0.12 and 0.11 respectively. 

The probable error of the difference 0.6 between the grade 
of " Coca-Cola — Chero-Cola " and the average of the five in- 
fringements is 0.21. As the difference 0.6 is about 2.9 times 
greater than the probable error of the difference 0.21, the 
chances are about 19 to 1 that "Coca-Cola — Chero-Cola" 
does not deserve a grade as low as the average of the five 
infringements. The probable error of the difference 4.0 be- 
tween the grade of " Coca-Cola — Chero-Cola " and the average 
of the four non-infringements is 0.20. As the difference 4.0 
is 20 times greater than the probable error of the 020, there 
are practically no chances that " Coca-Cda — Chero-Cola " de- 
serves a grade as low as the average of the four non-infringe- 
ments. " Coca-Cola— Chero-Cola," therefore, stands with 
high validity above the average of the five infringements^ and 
the average of the four non-infringements. 
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In Table VIII, among the infringements the greatest differ- 
ence is 6.6, between " Cascarets — — Castorets " with a grade 
of 12 and " Club— Chancellor Club" with a grade of 7.8. 
Among the non-infringements the greatest difference is 4.4, 
between ** Sozodont — ^Kalodont " with a grade of 5.1 and 
" Holeproof— Knotair " with a grade of 9.5. In Table IX 
the average of the five infringements is 3.4 higher than that 
of the four non-infringements. Thus the differences within 
either class of decisions are greater than between them. Two 
non-infringements, three if we include "Coca-Cola — Chero- 
Cola," are more confusing than the lowest infringement. The 
two most confusing imitations are infringements, and the two 
least confusing non-infringements. In sound confusion the 
results point consequently as did those in visual recognitive 
confusion to the imreliability and inconsistenqr of the legal 
decisions and of the present legal procedure. The difference, 
however, between the averages of the infringements and non- 
infringements in sound confusion by relative position is 
greater than in visual recc^^ition confusion, and indicates a 
greater accuracy of the decisions. 

A comparison of Tables III and VIII will show that the 
positions of the same pairs of marks in the two lists have 
changed in most cases. " Green Rivei< — Green Ribbon " is the 
only pair that did not change its position. " Coca-Cola — Chero- 
Coia " changed only one-half of a position, " Holeproof — Kno- 
tair ** changed one position, " Listerine — ^Listogen ** and 
" Gold Dust — Gold Drop " two positions, " Grape-Nuts — 
Grain-Hearts ** and " Club — Chancellor Club " three, " Sozo- 
dont— Kalodont " four, " Mother's— Grand-Ma's " five and 
one-half, and "Cascarets — Castorets" six. The average of 
the number of positions changed for the 10 pairs of marks is 
2.7. The lack of exact correspondence between the positions 
of the same pairs in both lists does not mean that the methods 
or resuhs are contradictory or inconsistent. Though in both 
experiments presentation of material was through vision, 
each experiment principally affected two different senses. 
Exact correspondence would most likely have existed between 
the two lists if they were both concerned with measuring the 
same thing. 

Conclusion 

1. The word "Chero-Cola" shows a likelihood of visual 
confusion with the word " Coca-Cola." With one imitation in 
the experiment and when the marie is used without the name 
of the commodity, 28 per cent, of all the observers confuse 
in visual recognition the word "Chero-Cola" with "Coca- 
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Cola.^ With one imitation in the experiment and when the 
mark is used with the name of the commodity, 68 per cent, of 
all the 6bservers confuse in visual recognition the words 
"Chero-Cola Soft Drink" with "Coca-CoU Soft Drink" 
With 10 imitations in the experiments and when the marie is 
used with the name of the commodity, 40 per cent of all the 
observers confuse in' visual recognition the words "Chero- 
Cola Soft Drink" with "Coca-Cola Soft Drink." Thus, 
either with or without the name of the commodity added to 
the trade-mark, with or without other imitations present, the 
word "Chcro-Cola" shows a likelihood of confusion in 
visual recognition with "Coca-Cola." It should be observed 
that the per cent, of likelihood of confusion is not an absolute 
number representing the exact per cent, of individuals that 
would be confused in daily life. The per cent holds approxi- 
mately under the simple standardized conditions of the 
expieriment. 

2. Most of the observers confused are " absolutely certain " 
that they had seen the word " Chero-Cola," and only a few are 
either " reasonably certain " or have a " faint idea." That is, 
most of the observers put the greatest confidence in their 
wrong recognitions, and in so doing testify to or affirm their 
great belief that they are right. 

3. Most of the observers confused state that they were 
"perfectly familiar" with the trade-mark "Coca-Cola" be- 
fore they saw it in the presentation of the experiment, and 
only a few were either " moderately familiar " or " just fa- 
miliar ; " none were " unfamiliar " with it. 

4. Confusion in visual recognition caused by " Chero-Cola " 
is greater than that caused by the imitations of the other three 
very well-known original marks; it is 12 per cent greater 
than the confusion caused by the infringing imitation of " Cas- 
carets," 14 per cent, greater than that of the infringing imita- 
tion of "Gold Dust," and 22 per cent greater than that of 
the non-infringing imitation of " Grape-Nuts." " Qiero- 
Cola " has a score of 8 per cent, less than the most confusing 
non-infringement, 6 per cent, less than the most confusingly in- 
fringement, ties with another non-infringement, and has a 
higher score than four infringements and two non-infringe- 
ments. The confusion in the case of "Coca-Cola — Chero- 
Cola " is about 7 per cent, greater than that of the average of 
the five infringing pairs of marks or of the four-fton-hrfring- 
ing. The average of the infringements is only 0.7 pci^ cent, 
higher than that of the non-infringements; practically this is 
no difference. 
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5. As detennined by the average per cent, of observers that 
correctly realized the duplicate and new marks, the task set 
the observer in the experiment is of moderate difficulty. In 
the three recognition experiments the average per cents, of 
corrct recognitions of the duplicate and new msirks is 87, 79, 
and 85 per cents. The figures indicate then that the task set 
is not too arduous, nor exceedingly easy. 

6. In measurement of confusion in sound by relative posi- 
tion "Coca-Cola — Chero-Cola" with a grade of 3.6 (P. E. 
0.17) is in the third most confusing position in the list of 10 
pairs of litigated trade-marks. It is ranked nearly equally 
confusing with one infringement, less confusing than two in- 
fringements, and more confusing than two infringements and 
all four non-infringements. 

7. "Coca-Cola — Chero-Cola" has a higher rank of confusion 
than both the average of the grades of the infringements, 
and the average of the grades of the non-infringements. 
It is with h^;h validity above the average 4.2 (P. E. 0.12) of 
the five infringements, and above the average 7.6 (P. E. 0.11) 
of the four non-infringements. 
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THE ANALYSIS OF TRADE ABILITY 



By Edwabo S. Robinson, Yak University 



I. Introductory 

The control of learning and the measurement of acquired 
abilities are among the most important personnel problems be- 
fore the industrial psychologist. He will find that these prob- 
lems hdd fully as great opportunities for the application of the 
method of his science as do the problems of intelligence testing. 
Although he has no ready-made formulas for dealing witii 
the situation, he has a psychological, or better, an empirical 
point of view toward htunan l^havior. By virtue of this 
point of view he can, if he will, contribute a systematic analy- 
sis of many problems of industrial behavior which seem so 
stubbornly to resist analysis on the part of the average man 
who is familiar with industry, but unfamiliar with psycho- 
logical methods. 

The possibility of applying psychological methods to the 
problems of acquired behavior in industry can best be illus- 
trated by reference to the woric of the late Trade Test Division 
of the Committee on Classification of Personnel in the Army. 
This organization had as its task the development of standard- 
ized tests for measuring the trade ability of men entering the 
National Army. It was the purpose of this work to increase 
the accuracy of selecting men best fitted for particular army 
jobs requiring special abilities. Civilian occupations seldom 
furnished exact counterparts of these army jobs, but cor- 
respondence was close enough and frequent enough to give a 
very high value to any information which could be ol^ined 
regarding a man's industrial experience. The trade tests were 
designed to check up on statements of soldiers concerning 
their pre-military occupations, and, further, to measure their 
proficiency in trades at which they claimed to have worked. 
The development of these tests required the observation, from 
a psychological point of view, of a great number of trades and 
tradesmen. I shall try to summarize here the results of those 
observations in so far as they apply, not to specific trades, but 
to trades in general. 

Although it has some basis in a rather loose usage, the mean- 
ing of the term trade as used in this discussion is largely arbi- 
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trary. It does not, of course, refer to occupations mainly 
concerned with the exchange of goods, but rather to occupa- 
tions emphasizing an acquired facility in the use of certain 
tools^ instruments and machines for the achievement of cer- 
tain classes of physical results. Moreover, this acquired 
facility or skill consists of a complex set of coordinations, in- 
tellectual, motor, or both, such as we find in carpentry, in- 
teri6r wiring and the like, and not of the very simple and oft 
repeated coordinations typical of the operation of much 
standardized factory madiinery. Trade ability refers, then, 
to any complex set of coordinations which we find character- 
izing all men skilled in a given trade and marking them off 
as a single group. 

II. Defining Trades 

There are in existence scores of books and pamphlets 
which attempt to define the trades of modem industry, but 
scientifically most of these are of little or no value. Practi- 
cally all of the writers of these definitions have fallen into an 
easy fallacy which appears when we look into their methods. 
Having a given title, say armature winder, before them, they 
have set out to collect from all possible sources descriptions 
of the jobs of armature winders. They have then tabulated 
these descriptions and issued them as a full and complete 
definition of the armature winder — as a guide for identifying 
the skilled armature winder wherever he may be found. But 
when we try to make such practical use of the definition, we 
find that it does not work. Only in negligible instances do we 
find the type of man we are looking for. According to the 
definition a skilled armature winder is a man capable of 
working on *'A.C." and " D.C." windings, on " hand " and 
" form " windings, etc. Our natural inference from this is 
that the man who only partially fills these requirements is 
only partially skilled. We find, however, that there are men 
with all sorts of partial combinations of these enumerated re- 
quirements who are, nevertheless, classed as winders of the 
first rank by their bosses and co-workers. From this it is 
apparent that *' armature winding " is not a single trade, but 
a name which has been applied indiscriminately to a variety 
of trades. The trade of armature winding, pure and simple, 
does not exist. 

In order to frame useful trade definitions, then, the inves- 
tigator must be thoroughly empirical. There is only one 
reliable source of information about the requirements of a 
trade and that source is to be found in the observed abilities 
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of individual tradesmen. Industrial experts of one kind or 
another may safely be consulted for a bird's-eye view of a 
trade whose definition is required, but such experts are not to 
be relied upon for detailed or exact opinions. The classifica- 
tion and description of workers according to their peculiar be- 
havior equipments is a thing whidi must wait upon the field 
observations of men who have the training and patience to 
be inductive and empirical. Such a procedure will result* in 
definitions or specifications quite different from those to be 
found in the large mass of current trade literature. We shall 
find that the tradesmen who can actually be identified in 
industry are "A.C." men, "D.C." men, form winders, hand 
winders, or general repairmen, etc. and not armature winders. 

III. Elements of Trade Ability 

The detailed work of tabulating the pertinent items of be- 
havior of individual tradesmen requires a definite basis of 
analysis. In the Trade Test Division we found it convenient 
to conceive of ability in a trade as made up of a group of 
elementary abilities. These simple abilities, while not neces- 
sarily unanalyzable, are of such a nature that when further 
reduced they bear no apparent relationship to the complex 
trade ability of which they are parts. The riveting of the 
sheet metal worker is an element of his trade ability, although 
the behavior here involved is evidently open to further analy- 
sis. Such further analysis would, however, yield items of be- 
havior with no apparent relationship to sheet metal working 
ability and, therefore, of irrelevant fineness. In all trades 
analysis stopped with the discovery of the simplest relevant 
imits of ability. 

From a psychological point of view the analysis of any 
trade brings out elements of two main sorts: (1) Intellectual, 
and (2) Mx)tor. While in the strictest theoretical sense no 
sharp line can be drawn between these two categories, we may 
say roughly that the intellectual elements are the items of in- 
formation and habits of judgment employed in meeting trade 
situations. Such items of information are displayed when a 
carpenter recognizes a mitre, a shingle hatchet, a valley rafter 
etc. Typical habits of judgment are displayed when an in- 
terior wireman selects one rather than another rosette as a 
ceiHng fixture for a drop cord and when he decides to cover 
a bit of wire with porcelain tubing instead of Itmie. The 
motor elements are the coordinations involved in the tmique 
muscular movements of tradesmen. The wood pattern maker 
possesses a large variety of nice coordinations which are 
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manifest in his manipulation of numerous chisels, planes and 
other tools. Shifting geers, accurate steering, etc., are motor 
elements of automobile driving. 

When the Trade Test Division first faced the problem of 
measuring trade ability, a very confident opinion was expressed 
in all quarters as to the relative importance of intellectual and 
motor elements in trades in general. Psychologists, engineers, 
and tradesmen themselves insisted that the skilled tradesman 
is characterized by his manual rather than by his intellectual 
training, and that, on the other hand, there are large numbers 
of men having a thorough intellectual grasp of trades they 
cannot practice. The point seemed well taken and influenced 
appreciably the direction of our earlier attacks upon the prob- 
lem of measurement. Concretely, this point of view appeared 
in an a priori confidence that performance tests would meas- 
ure trade ability more accurately than oral or other tests 
emphasizing information and judgment. But increasing 
knowledge, gained from first hand observations of industrial 
conditions, soon made clear that this weighting of motor ele- 
ments was based upon an outgrown state of afiFairs. Undoub- 
tedly it was once true that ability in perhaps a majority of skill- 
ed trades was characterized by motor habits, to be acquired only 
after long and arduous training. This, however, is no longer 
the case. Pattern making, automobile driving and some other 
present day trades emphasize the motor, but far more common 
are the electrical trades, the machine trades, etc., which are 
largely intellectual and whose motor habits, with few excep- 
tions, are relatively simple and easily acquired. 

This statement that trades are becoming more intellectual 
may need reconciliation with the fact that modem industry 
calls for little intelligence from the run of her workers. 
Especially since the beginning of the war manufacturers have 
reduced the complexity of the duties of individual workers 
by cutting up trades into operations. Under such conditions 
it has been possible to use practically unskilled labor in the 
production of intricate mechanical products. But where jobs 
have remained complex and where workers have remained 
tradesmen in the sense in which I have defined that term, 
there has been a growing emphasis upon the intellectual as 
opposed to the motor. Each new machine introduced into 
industry tends further to emphasize the knowledge and judg- 
ment requirements of workers and to do away with skilled 
movements previously required. 



Digitized by 



Google 



356 ROBINSON 

IV. Variations in Trade Ability 

In any trade ability ranges from that of the novice to that 
of the expert. The way in which trade ability develops can 
conveniently be studied by listing the elementary abilities 
manifest in men whose industrial status indicates just what 
stage they have reached in the learning process. In the novice 
we find no item of knowledge, no habit of judgment, no mus- 
cular movement which is a genuine element of the trade in 
question. The presence of such an element in a novice indi- 
cates one of two things : either the novice is not a novice, but an 
immature tradesman; or this particular element is extraneous 
to the trade and should, therefore, be excluded as a partial cri- 
terion of ability in that trade. In the expert we find a maxi- 
mum number of genuine trade elements. In men whose status 
is something between novice and expert we find a partially 
complete group of trade elements. 

The building up of a group of trade elements — the learning 
of a trade — takes place in a definite, fairly predictable way. 
The order in which the individual elements are acquired is 
not a matter of chance, but for the most part is the same for 
all tradesmen within a single trade. That is to say, most 
trade elements tend to appear at some definite stage in the 
learning process. Hardly any apprentice battery mechanic 
can do a successful job of " lead burning " on the top of a 
battery, while this same task is easy for almost any battery 
mechanic who has passed the apprentice stage. Similarly, 
technical knowledge of roofing appears somewhat suddenly in 
the process of learning house carpentry. These elements 
which tend to appear suddenly may be classified in the follow- 
ing fashion: 

1. Trade Elements: Those possessed by practically all 
workers in a trade — apprentices, journeymen and experts — 
and by no one not in that trade. 

2. Journeyman Elements: Those possessed by practically 
all journeymen and experts and by no apprentices or novices. 

3. Expert Elements: Those possessed only by experts. 
If for an element of any of these types we should plot the 

correlation between the probability of its appearance and trade 
status, we would obtain a sharply curved regression. Figures 
1, 2 and 3 show the plotted correlations for hypothetical ele- 
ments of each of the above types. 

In our studies we found that the most frequent elements 
were those belonging to the first of the above classes. Ele- 
ments tending to appear at the journeyman stage were next 
most frequent. Elements tending to appear at the expert 
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Stage were quite rare. Increments of trade elements, then, 
grow smaller and smaller as progress is made toward expert- 
ness, and trade learning as measured by the acquisition of new 
elements is a negatively accelerated function. 

Besides these elements, each of which has a definite point 
of appearance in the prc^ess of learning, there are other ele- 
ments whose probability of appearance, when correlated with 
trade status, gives a linear regression. Figure 4 shows a 
hypothetical element of this type. Such elements can be de- 
scribed as appearing in no novices, in a few apprentices, in 
more journeymen, and in still more experts. In our work we 
ran across comparatively few elements of this kind. 

V. The Me<isurement of Trade Ability 

Having once classified the elements of a given trade the 
construction of a test for that trade is simple. If the object 
of the test be that of separating men on either side of a point 
along the range of ability, it is necessary to include in that 
test only questions or job specifications calling for a display of 
elements tending to appear at just beyond that point. If, on 
the other hand, the object be that of separating men at several 
points along the range of ability, then the test should include 
elements tending to appear at just beyond each of these points, 
or elements whose probability of appearance increases gradu- 
ally along the range of ability, or elements of both classes. 
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A WRITTEN TRADE TEST: MULTIPLE CHOICE 

METHOD 



By J. Crosby Chapman, Western Reserve University; and 
Herbert A. Toops, Teachers College, Columbia University 



The Army Trade Test Division was, on a priori grounds, ex- 
tremely sceptical of written trade examinations. For this 
reason, in the theoretical examination, an oral test was used. 
The oral method has proved its power to distinguish, with a 
fairly high degree of certainty, between novices, apprentices, 
and journeymen, and to a less degree between journeymen 
and so-called experts. The possibilities and limitations of 
one type of written test form the subject of this article. In 
connection with the work of this Division an opportunity was 
given of trying out a written trade examination constructed 
on the multiple-choice plan. There are many advantages in 
being able to give group examinations of this kind. Among 
these are: (1) conservation of examiner's time, (2) reduc- 
tion of scoring time and increase of scoring accuracy through 
the use of stencils, etc., (3) elimination of subjective judg- 
ments, (4) the possibility of rapidly eliminating the trade 
" bluffer," leaving only those who show evidence of some 
knowledge for further consideration or examination by means 
of oral, performance, or picture tests. 

Assembly of Questions 
In conference with expert tradesmen, sixty-two questions 
were prepared, each question having four possible answers, 
of which one was correct. Nearly all the questions of the 
army oral test for Bricklayers, partly collected by the authors, 
were adapted to this form of examination, and the remainder 
were secured from other sources. Trade terms were used 
almost exclusively in the four answers from which the choice 
was to be made, on the supposition that a person might be able 
to recognize a trade term from among a number of terms not 
applicable to the trade and yet have no real knowledge of 
its significance. A part of the test is reproduced. 
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BRICKLAYERS' TEST* 
Directions: 

In the sentences below, there are four choices for a correct sentence. 
Only one of the four choices is correct. Draw a line under the one choice 
which makes the best sentence. If you are not sure, guess; an omitted 
answer will coimt as a wrong answer m determining your score. The first 
two sentences, A and B, are answered correctly as a sample for you. Read 
them carefully, then go on to question 1, question 2, and so on to the end of 
the list. 

Samples: 

A. A half of a brick is called a: chunk, block, heel, bat. 

B. Fire-bricks are laid in: concrete, cement, fire-day, mortar. 



Questions: 

1. The top course of stone on a wall is called: coping, bond-st(»ie» 

clip-course, capstone. 

2. A brick set on end is called: upright, soldier, row- 

lock, stud. 

3. Before plumbing up a comer, you should 

lay: 3-courses, 6-courses, 9- 

courses, 12-courses. 

4. A brick that is set on the narrow edge is 

called: stretcher, oarkxzk, row- 

lock, header. 

5. In coming to a hei|;ht, if there is a course of 

brick difference m the level, you would call 
it a: haimch, filler, line-level, 

hog. 

6. Fillin£-in the space between a front and 

bade course of brick is called: slushing-up, tempering, 

tuck-pointing» plas- 
tering. 

7. Bricks laid across the wall reaching to the 

face are called: stretchers, headers, lay- 

ers, fillers. 

8. A fire stop around a tiue is formed by a: coping, skew-back, cor- 

bie, indent. 

9. If you have no metal ties in plain bond 
work, the front work of a building is tied-in 

with: king-course, clip-course, 

projectkm-course, belt. 

10. In backing a 4-inch ashlar stone wall, you 

would tie it with: tie-jcHnt, binder, brace, 

andior. 

11. A brick cut in half lengthwise is called: filler, soap, bat, chunk. 

12. Tokeepthelinelevdinthemkkileofalong 

wall you use: level plumb-line, square, 



13. In cutting a brick you would use a: diisd-bar, striker, brick- 
set, cutter. 

^These ei^^teen questkins were selected from the original set of mxty-two, 
which constituted the examinatk>n. This 8dectk>n was made on the 
basis described in the text. 
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14. The distance above the frame for a lintel 

should be: i-inch, {-inch. 1-inch, 

U-inches. 

15. An ordinary stone sill should be bedded on 

the: front, back, solid, two 

ends. 

16. To locate a building you use: water-level, sifter. 

transit, line-level. 

17. A skutch is used in cutting: cement, glazed-tnick, 

stone, fire-brick. 

18. Another name for a blind header course is: belt-course, clip- 

course, dental-course, 
hidden-course. 

The answers to the above questions with the percentages 
of experts passing each are as follows: 

1. Coping— 98% 7. Headers— 98% 13. Brick-set— 100% 

2. Soldier— 98% 8. Corbie— 85% 14. i-inch--88 % 

3. 3-courBe8— 88% 9. Clip-course— 100% 15. Two-ends— 93% 

4. Rowkxdc— 100% 10. Anchor— 85% 16. Transit— 88% 

5. Hog— 100% 11. Soap— 85% 17. Fire-brick— 100% 

6. Slushing-up— 98% 12. Trigger— 93% 18. Clip-course— 93% 

The Subjects of the Experiment 
The examination was given without time limit to 101 per- 
sons, distributed as follows: 35 novices without trade experi- 
ence, 4 apprentices, and 62 trade union members. Of the 
novices, 29 were soldiers in an army training school, being 
instructed in other trades at the time, but inexperienced in 
the bricklayers' trade. These men were mechanically inclined, 
and above average in intelligence and education. It is ob- 
vious, therefore, that the questions were subjected to much 
more intelligent guessing than ordinary condKtions, under 
which they would be employed, would furnish. Of the other 
six novices, 3 were stenographers who had several days ex- 
perience, immediately preceding this test, in taking and tran- 
scribing stenographic notes relating to the general subject 
of bricklaying. The other 3 novices were clerical workers 
in the Department of Psychology of Carnegie Institute of 
Technology. These subjects were well informed concerning 
the technique employed in assembling such tests, and used 
various methods of " suggestion, inspection, and elimination " 
in efforts to make as high scores as possible. 

Owing to the great scarcity of apprentices, only four could 
be examined. Their length of trade experience ranged from 
one month to five years. In view of experience and perfor- 
mance in the army oral test, the lowest apprentice can be con- 
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sidered little better than novice, while the best apprentice 
perhaps deserves to be ranked as a low journeyman. 

The tradesmen, being all members of the union, more than 
fulfil the minimum entrance requirements in point of years of 
trade experience and skill. On the basis of their own written 
statements in regard to years of trade experience, type of 
work, and foremanship ability, these 62 men were divided by 
the authors into the two following groups: (a) 36 journey- 
men (hereafter called J.) or men of medium amount of skill 
and knowledge; (b) 26 experts (hereafter called E.), men of 
superior skill, knowledge and foremanship ability. This rather 
arbitrary classification was made in an effort to determine 
from the results of the examination whether a set of questions 
could be so selected as to differentiate not only non-tradesmen 
from tradesmen, and apprentices from skilled men, but also 
journeymen from journeymen experts, so divided. 

Presentation of Results 

Four points were allowed for each correct answer; there 
were no partial credits. Four points was selected as an ar- 
bitrary value because of army custom. A graph for each ques- 
tion was drawn, showing the average score made by novices, 
apprentices, journeymen and experts. Samples of such graphs 
are shown in fig^ 1. Since little was known as to the most 
desirable combination of questions to make up the best set 
for an examination, five methods of combining varying num- 
bers of questions were tried; only two of these methods are 
here described. 

Method I is the entire set of 62 questions. 

Method II is a selection, from the original 62, of 18 ques- 
tions, chosen on the basis of the combined judgments of three 
persons experienced in similiar selection for the army oral 
trade tests. The requirements for a question in the army 
tests were : ( 1 ) increasing average scores from class to class, 
novices to experts; (2) a fairly low average novice score; 
(3) a comparatively high average expert score. The ideal 
type of question for the choice-method is shown by the straight 
line of fig. 1. 

The distribution of scores by Method I are given in Graph 
I. By inspection, arbitrary lines of demarcation of N-A, and 
A- J may be made, corresponding to the number of questions 
correct as follows: 
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Novice score 0-30 

Apprentice score 31-42 

Skilled tradesmen 43-62 

It can be seen at once that the test does not differentiate 
between the journeymen and expert classes. Either the divi- 
sion into these two classes by judgments, based on the men's 
written statements, has nothing to do with the men's ability 
to answer this form of question, or the test as given is not 
sufficiently difficult to differentiate among skilled tradesmen. 
The homogeneity of the skilled tradesmen class as to scores 
can be easily seen from Graph I, where the expert distribu- 
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tion has been added to the journeyman distribution by means 
of the dotted squares. 

With the two arbitrary critical lines just mentioned, only 
three skilled union men out of 62, or less than 5 per* cent; 
are displaced out of this larger class into the apprentice class. 
We can assume that all union men have had four years trade 
experience and possess a certain minimum requirement of 
ability. The apprentice, with only one month's experience, is 
here rated with the novices, as is only fair under the condi- 
tions. His guessing ability is as poor as the poorest novice, 
from which we can asstmie that he has learned next to no 
trade terms in one month of trade experience. Our own 
judgment is to the effect that intelligence is a better single 
measure of trade skill than are years of trade experience, 
after a certain minimum time for learning has elapsed. 
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By chance alone, the poorest novice should theoretically 
be able to answer 15 of the 62 questions correctly (one out of 
every four). Here, only two novices fail to come up to this 
standard, and they fail by only a single question each, both 
answering 14 questions correctly. The average novice answers 
a little better than 19 questions. 

If the object is merely to separate skilled tradesmen from 
the apprentices, or the tradesmen of experience from the "trade 
bluffers," the complete set of questions of Method I is a re- 
markably accurate instrument for so doing. For this purpose, 
with the persons tested, it is at least 95 per cent efficient. 

Method II, which is the selection of the best 18 questions 
according to the usual army criteria, gives us, with the ar- 
bitrary lines of demaracation adopted in Graph II, a slig:htly 
better separation of the three classes — novices, apprentices, 
and skilled union workmen. The one apprentice, with one 
month of trade experience, is still placed with the novices, 
but is now better than the average novice, and only one skilled 
union tradesman (a journeyman) is rated as an apprentice. To 
make the separations indicated, the test is 98 per cent efficient. 
This would probably be lowered if we had a fair sampling of 
apprentices. 

Nevertheless, in determining the efficiency of a test for in- 
dustrial purposes, it seems desirable to weigh the classes ac- 
cording to their frequency of occurrence in industry ; if there 
is only one apprentice for every 25 skilled men in industry, 
an employment manager would be unable to make many mis- 
takes by hiring apprentices under the impression that they were 
skilled men. 

In industry, also, it seems desirable to measure the efficiency 
of test methods by taking into account the amount of damage 
caused by misplacement of a man by the test, some such meas- 
ure as " dollar displacements," as suggested by R. W. Kelly. 
For it is a greater industrial mistake to give a journeyman or 
expert rating to an apprentice than it is to rate a novice as an 
apprentice ; this may he seen from a consideration of the rela- 
tive amounts of responsibility and wages involved. 

From Graph II, Method II, we note that there is a slightly 
better differentiation of J. and E. than in Method I, but not 
sufficient to justify any arbitrary line of division between the 
two classes. If a line were drawn at 60-64, only two experts 
would be classed as J. while over half of the J. would be 
classed as E. 

The final selection of questions, used in Method II and per- 
centages of experts answering each correctly, are given in the 
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preceding sample. The average scores and average devia- 
tions of the trade classes in both sets of questions are shown 
in Table I. 

TABLE I 

Average Scores and Average Deviations Therefrom, by Methods 

AND BY Trade Classes 



Trade 


Method 


No. of 


Class 






Cases 




I 


II 




Novices 
Apprentices 


78.3 

=bl2.5 

128.5 

±37.5 


12.5 
±5.1 

37.0 
±8.5 


35 
4 


Journeymen 


206.4 
±12.7 


63.3 
±5.9 


36 


Experts 

Pbssible 
Score 


2074 
±14.3 

248 


66.8 
±3.9 

72 


26 

Total 
101 



Summary 

(1) A written trade examination, based on the multiple 
choice answer method, was given, without time limit, to 35 
novices, 4 apprentices, and 62 journeymen. 

(2) Two combinations of questions were tried — ^the com- 
plete set of 62 and a specially selected series of 18. 

(3) Both combinations, with a very high degree of accuracy, 
separate the novices, apprentices and journeymen, but neither 
of them differentiate between the journeymen and the so- 
called experts, although the eighteen-question set is slightly 
more efficient. 

(4) In the absence of extreme language difficulty, the writ- 
ten group examination can be used with great advantage to 
(1) eliminate the bluffer, (2) to separate the apprentice of 
average attainment from the journeymen. 

The authors acknowledge the help accorded them by Messrs. 
T. J. Kirby, R. Pintner, and R. M. Reinhold, all members of 
the Army Trade Test Division. 
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MINOR STUDIES FROM THE PSYCHOLOGICAL 
LABORATORY OF INDIANA UNIVERSITY 

III. The Relation of the General Intelligence of 

School Children to the Occupation of their 

Fathers 



By S. L. Pressey and Ruth Ralston^ 



1. Problem and Materials, It has been generally recog- 
nized by workers with tests of intelligence — from Binet on — 
that results with such tests from school children may vary 
surprisingly from one neighborhood to another; children in 
one neighborhood may average as much as three years in 
" mental age " above children in another type of neighbor- 
hood.^ It has usually been argued that such diflferences were 
but further evidence of the superior native ability of the people 
living in the more prosperous communities, and of the inherent 
incapacity of the poor. That is to say, a direct correlation has 
been thought to exist between the economic and sociological 
status of a neighborhood or locality and the intelligence of 
its people, — as measured in its school children. 

Such community comparisons, by means of mental tests, 
are as a matter of fact, decidedly interesting, and have value 
both psychologically and sociologically. The test findings 
may, apparently, reflect local conditions with surprising de- 
tail.* It is obvious, however, that to select children by neigh- 
borhoods is to select them very roughly indeed ; if we wish to 
study the relation between the mental endowment of school 
children and the economic and sociological status of their 
families we should select our cases according to some eco- 
nomic or social standard which can be applied to each particular 
child or family in question. Children might thus be grouped 

^ Help in the collecting of the data was also given by Mr. J. Ward 
Starr. 

2 See for instance W. Stem, The Psychological Methods of Testing 
General Intelligence, pp. 50-57; Terman, The Measurement of Intelh* 
gence, pp. 114-118; Ycrkes, Bridges and Hardwick, A Point Scale for 
Measuring General IntelHgence, pp. 73-83. 

* See for instance, Press^ S. L., A Comparison of Two Cities and 
their School Systems by Means of a Group 'Scale of Intelligence, 
Journal of Educational AdnUnistration and Supervision, Vol. V, 1919, 
pp. 53-^. 
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according to the income of the family, according to home con- 
ditions, according to the occupation of the wage earner, or 
with reference to any similar criterion. 

Results from such a study should contribute not a little to 
our tmderstanding of local differences in the general intelligence 
of school children. The findings should, however, have an 
interest quite as great in their bearing on other sociological 
problems. If, for example, we measured the intelligence of 
the adults of a community, we would expect (if the present 
social unrest has any adequate basis) to find not a few men . 
and women in positions much below the level of their abili- 
ties, and incapable individuals not infrequently in responsible 
places. Test measurements of the exactness desired can 
hardly be obtained directly from adults, because of the speciali- 
zation of function that th^ workers already on the job have 
acquired, and because of the tendency of mental tests, thus 
far, to favor those in the more clerical lines of work. But, 
if mental ability is hereditary, then measurements of the 
children of these workers should give the information desired. 
If, for example, the brightest child in a hundred should be 
found to be the child of a diy laborer such a discovery would 
surely be of decided interest from many points of view. 

The present paper thus attempts: (1) to obtain some 
measure of the average diflPerences in general intelligence 
found between children coming from different kinds of homes, 
and (2) to examine the amount of over-lapping between the 
different groups — the extent to which children of .every de- 
gree of ability may appear in each type of family. 

The scale of intelligence used in this study was developed at 
Indiana University during the past year.* It will be described 
in detail in connection with the analysis by test given below. 
The city surveyed is a place of about 12,000 inhabitants. The 
business of the town centers around a large furniture factory, 
but there are also quarries near, and the place is the county 
seat and the center of trade for the county. The State Uni- 
versity is also located in the town. There is thus presented 
a variety of occupations and of economic levels that could 
hardly be found in the study of the same number of children 
in a single section of a large city. It should also be added that 
the town contains almost no foreign element ; the troublesome 

* Sec the report of the Seventh Annual Conference on Educational 
Measurements, Indiana University, April, 1919, or Cross-out Tests: 
With Suggestions as to a Group Scale of the Emotions, Journal of 
Applied Psychology, Vol. Ill, June, 1919, pp. 138-150. 
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factor of language handicap is to be considered almost 
negligible. 

The survey was made in April 1919. All the children from 
the third grade through High School were tested — a total of 
^ ^^ swne_J4iXlPf cases. In the study of the present problem. 
However, no children above fourteen or under ten have been 
considered, since shortly after becoming fourteen (the legal 
age limit) the children in the poorer families frequently leave 
school ; the children remaining are thus a selected group. A 
somewhat analogous difficulty prevented the inclusion of the 
younger children, eight and nine years old. Many of these 
were still in the first two grades where the scale could not be 
used; and since the factors being studied might well show 
themselves in school retardation, it was felt that the younger 
children tested were again a selected group, as far as this 
particular problem was concerned. There were a total o f 707 
children within these age limits (10-14 inclusive) in the city 
schools, examined with these tests on the day of the survey. 
The occupation of the father of each one of these children was 
looked up in the school record, the records being checked by 
one of the writers, who is a teacher in the system, and well 
acquainted with many of the families. A total of 548 cases, 
the occupation of whose father was known, were found.* These 
548 cases were now classified in four groups according as 
the father was (1) a professional man, (teacher, lawyer, doc- 
tor, minister, editor), (2) an executive (independent busi- 
ness man, foreman), (3) an artisan (electrician, engineer, 
skilled workman), or (4) laborer (section hand, factory op- 
erator, unskilled laborer). 

2. Results, The children were distributed by age and 
occupational groupings as follows : 

^ The desired information could not be secured for the remaining 
159 children within the five ages selected for study; they had moved 
away since the tests were given and the cards had been withdrawn, 
or the card failed to show the occupation of the parent— or the data 
was otherwise incomplete. The writers can see no reason, however, 
for supposing that these omissions have affected the trend of the 
results in any important particular. The occupation of the parent was 
chosen as the basis of classification from the various possibilities men- 
tioned above largely because it was definite and because data could be 
obtained in the largest proportion of the cases. No other single fact, 
of this importance for the problem, could have been secured for even 
half the number of cases it was desired to include in the data. 
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Age 10 II 12 13 14 Total 

Number 125 116 107 99 101 548 

Occupation Professional Executive Artisan Laborer Total 

Number 57 106 138 248* 548 

111 handling the results the total score made on the examina- 
tion has first been considered, and has been taken, for the 
moment, to represent a final rating of " general intelligence." 

From a table showing the distribution of scores at each age, 
for each group, the medians, ten and ninety percentiles were 
calculated for the entire number of children at each age. The 
per cent of children in each group scoring above the median 
for their age was then worked out as shown in Table I. 

TABLE I 

Per Cent of Children in Each Occupational Group Above the \ 
Median for the Entire Group 



Occupational Groups 10 11 12 13 14 All Ages Combined 

Professional 93 85 80 81 86 85 

Executive 58 44 56 76 68 68 / 

Artisan 52 32 48 38 40 41 / 

Laborer 38 41 39 34 40 39 

It will be seen that the results are what is to be expected 
as far as the average of general mental ability is concerned. 
The children of professional parentage test as superior while 
the children of day laborers test as relatively poor in mental 
endowment. Apparently, there is a direct correlation between 
occupation and mental ability. 

But the more important question as to the compactness of 
the distributions and the amount of overlapping from class 
to class, is still to be considered. The per cents of children in 
each occupational group who make scores in the highest and 
lowest ten per cent for their age run as follows : 

Prof. Exec. Art. Labor. 

In highest 10% 41 10 8 6 l^ 

In lowest 10% 1 2 12 17 

" The large plurality of the unskilled laborers would in itself seem 
of some significance in connection with the second problem above. A 
multitude of factors are undoubtedly involved. But there are surely 
suggestions here that more men are in the lowest t3rpe of ocupations 
than we would expect from a normal .distribution of ability to be 
capable of no more than the least skilled work. 
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The results of this analysis are most interesting. There 
was one child of a professional man who scored in the lowest 
10% for his age; otherwise the children from professional 
homes form the bulk of the highest ten per cent. The more 
compact distribution of the scores in this group is due, perhaps, 
to the fact that the professions have more definite require- 
ments than do the other occupations as regards general in- 
telligence. At the other extreme in almost every respect is 
the group of children whose fathers are unskilled laborers. 
These children give scores ranging from the very poorest to 
the best; there are some children of common laborers who 
score in the highest ten per cent for their age. These facts 
would seem to confirm the statement, made frequently, that 
in the present day industrial world, the level of work is much 
below the level of ability of the worker. It would certainly 
suggest that many individuals were not where they belonged, 
— were employed in positions calling for much less than their 
best.^ 

However, with such striking results, one naturally ques- 
tions the validity of the tests, and wonders whether the na- 
ture of the scale may not have influenced the findings in some 
illicit way. The four tests composing the scale were selected 
after extended study as being highly differential of mental 
subnormality and superiority, and relatively free from the in- 
fluence of other factors. Still it is conceivable that the tests 
might reflect home environment to a greater extent than is 
usually thought. Analysis by test should help not a little in 
answering this question. 

The four tests of the scale may be briefly described. The 
first consists of twenty-five sentences with the words dis- 
arranged, and among the words of each sentence one word 
that cannot be used in the sentence (So "boy was sky the 
sick"). The subjects are told to cross out this extra word. 
The second test is an information test; it consists of twenty- 
five lists of five words each. Of the five things named in each 
list four are alike in some important way and one thing is 

^ The smaller proportional representation of the laboring class in 
the fourteen year group is of interest in this connection; children of 
unskilled laborers make up 50% of the twelve year crfoup, but only 
37% of tiie fourteen year group. And though it is especially the duller 
children who thus drop out this appears to be not altogether the case — 
there is a thinning of the whole distribution. That is, the children of 
laboring people who arc quite as bright as children from more favored 
homes have much less educational opportunity. A similar analysis 
including children above fourteen would be interesting in thi«; con- 
nection. 
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di£Ferent; this one is to be crossed out (so " dog, cow, horse, 
oak, cat"). The third is a test of arithmetical ability. It 
consists of twenty-five series of digits, the digits being ar- 
ranged according to some rule, but Uiere being in each series 
one number that breaks the rule ; this number is to be crossed 
out (so " 2, 4, 6, 7, 8 "). The fourth is a test of vocabulary 
and of moral discrimination. It consists of twenty-five lists 
each of five moral terms (as " begging, buying, trading, cheat- 
ing, borrowing ") ; the subjects are to cross out the worst 
thing in each list. 

It might be objected, now, that a good or a poor score on 
such a scale might be quite as much 3ie result of a good or a 
bad home environment as of a good or bad mental endowment. 
Particularly the first and the last tests might be sensitive to 
such environmental factors; they would appear to be. to a 
considerable extent, reading and vocabulary tests, and a pros- 
perous home offers greater opporttmities for reading and the 
acquirement of general culture. Test II, however, should be 
much freer from such influences, as there are no words used 
in this test that are not in the vocabulary of the average child ; 
in fact, it is conceivable that the child from a poor home, 
who knocks about the streets, might be able to pass the test 
rather more successfully than tne more sheltered child from 
a good home. And it is difficult to see how the third test 
could be helped by a good environment to any appreciable de- 
gree. If, then, the tests are measuring environment as well 
as innate ability the first and last tests should show greater 
diflferences between the occupational groups than is shown by 
the two middle tests. But if the difference shown by each 
one of the tests is about the same then it would seem fair to 
conclude that the factor causing this difference was of a gen- 
eral and fundamental character, presumably mental endow- 
ment. 

Table III shows the per cent of children from each one of 
the four occupational groups who score, on each test, above 
the age median for the whole group. The five ages have been 
combined for the sake of simplicity. 

TABLE III 

Showing the Per Cent, of Qiildrbn prom Each Occupational Group 

Who Score Above the Median for Their Age (for the Total 

Group) on Each Test 



Occupational Group 


Test! 


Test II 


Test III 


Test IV 


Professional 


80 


80 


80 


87 


Executive 


58 


64 


68 


56 


Artisan 


56 


54 


51 


59 


Laborer 


47 


46 


48 


45 
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As may be seen from this table, the results are highly con- 
sistent from test to test. The results by test would suggest, 
therefore, that the scale really was measuring some funda- 
mental underlying factor such as native endowment, and that 
any special features of environment that might be e3q)ected 
to influence the record made on certain of the tests have not 
affected the scores to any important extent. The children 
in the first group (professional) are superior on eveiy test 
and the children of the last group (laborer) are inferior on 
every test ; the other groups also hold their place remarkably 
well. 

3. Discussion, Such an analysis by test seems to give some- 
thing of a measure of the " reliability *' of a scale for such 
purposes; in so far as the findings are consistent from test to 
test of those tests used, in just so far similar findings might 
be expected if other tests still were employed.* Too much 
must not, of course, be made of such inferences. It may very 
well be that subtle matters of attitude, differences in the total 
fund of information, and other influences immediately result- 
ing from differences in home environment, play no small part 
in such findings. But such differences are, after all, so funda- 
mental as to be of hardly lest importance than differences in 
native intelligence. 

The writers are convinced, however, that such environmental 
influences can also be specifically studied, with profit, by means 
of " group tests." An informational test to measure the ex- 
tent to which the more expensive conveniences, and luxuries, 
are known in the home would seem not at all impossible, — or 
a test to measure the amount and type of reading done outside 
of school. Tests of very little children, as they first enter 
school, should also get much closer to such differences in the 
intimate home influences.* The possibilities of the group test 
as a general method of investigation have not, the writers feel, 
been adequately appreciated. A multitude of problems, 
psychological, educational, sociological, await investigation by 
such means. 

4. Sutmnary. The paper reports an analysis, according to 
the occupation of the father, of results with a group scale of 
intelligence from 548 unselected school children 10-14 years 

8 That is, unless all the tests used were measuring some one special 
ability. A series of intercorrelations between the tests used in the 
present study will shortly be presented, to show that such is not true 
of this scale. 

•See the article referred to above, in the June number of this 
Journal. 
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of age. All of the children of these ages for whom complete 
data were available in a city of 12,000 population were in- 
cluded. It was found that: 

1. Of the children of professional men, 85% made scores 
above the median for the total group; of the children of ex- 
ecutives (independent business men, foremen) 68% rated 
above the median for the total group ; of the children of arti- 
sans (unskilled workers) 41% rated above the median, and 
of the cfiildren of laborers only 39% rated above the median. 

2. The groups overlapped largely, though not completely. 
Both extremes of the distribution contained some members 
from each occupational group : however, the artisan and labor- 
er groups predominate at the lower end of the distributions 
while the professional and executive groups show a majority 
of the high scores. 

3. Analysis by test shows these findings to be constant for 
all four tests. It is argued from this tluit the findings have 
some general reliability. 
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IV. A Practical Information Test 

For Use with Delinquents and Illiterate 
Adults 



By S. L. Pressey and I. M. Shively* 



1. Problem and Materials. Some three years ago the writer, 
while engaged in psychological work at the Boston Psycho- 
pathic Hospital, became much interested in tests of informa- 
tion to be used with delinquents. He came to feel that the 
Termism-Childs vocabulary test * was distinctly unfair in such 
cases. For such cases (and perhaps for the average healthy 
out-of-door child) it was not, he felt, an imselected list. A 
dictionary contains a greater proportion of literary words and 
of technical terms than is found in ordinary talk, especially 
among the lower classes; a dictionary covers primarily a 
reading, rather than a speaking vocabulary. An " unselected " 
list from a dictionary will, then, in proportion as it is unselec- 
ted, show this same specialization. The result is a distinct 
unfairness to the gang boy from the slums or the girl oflF the 
street; they not infrequently possess a bulk of information — 
unforttmate and otherwise. But they do not know Terman's 
list. The rating on his scale suffers accordingly, and the 
examiner obtains a distinctly false impression as to the indi- 
vidual's fund of ideas. The present paper is a brief descrip- 
tion of an attempt to formulate a test, of the general nature 
of Whipple's Range of Information test,* which should be 
especially applicable to such cases. 

The list was, in fact, expected to be of value for three pur- 
poses: (1) It should serve as a test of general intelligence, 
especially applicable to children from poor homes and to adults 
of scanty education. (2) It should, if the words were properly 
chosen and grouped so as to cover important "fields" of 

♦The writer (Dr. Pressey) is indebted to Miss Shively for Ac 
scoring and tabulating of the results — ^in fact, for all the real labor of 
the study — ^the work being done in connection with a summer school 
course in Mental Measurement 

1 See Terraan, L. M., The Measurement of Intelligence, Houghton 
Mifflin Ca, 1916, pp. 224-231. 

a Whipple, G. M. Manual of Mental wd Physical Tests, 191S Vol. 
2. pp. 317-322. 
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information, be of distinct value in the investigation of an 
individual's interests, and in sounding the extent to which he 
is acquainted with various types of experience — good or bad. 
(3) In the third place, it was hoped that the test might yield 
data of some value in connection with efforts to differentiate 
deteriorated individuals in work with the insane. Roughly 
it may be said that mental deterioration shows itself in a fund 
of knowledge much greater than would be accounted for by 
present capacity for acquirement of ideas. Such cases should, 
then, be distinguist;ed by a relatively good record on tests of 
information along with very poor records on tests of learning. 
As an informational test to be used for this purpose such a 
list as has been just suggested should be more satisfactory 
for the general run of psychotic cases than Terman's more 
literary list. The intention was to investigate the value of 
the test for each one of these three purposes. It has not been 
possible for the writer to complete the study as he had planned 
because of the many pressing demands of work in other direc- 
tions. But a description of the test and the tentative results 
thus far obtained may be of some interest. 

The list of words is shown below. It was arrived at by a 
study as to which fields of information were most familiar to 
the general run of cases at the Psychopathic hospital, by in- 



Rangb op Practical Information 



Moral Religious Governmental 



Legal 



Stealing Creed Mayor Jjuy 

Lying Disdple Senate Plaintiff 

Gambling Benediction Constitution Probation 

Cheating Heretic Tax Larceny 

Pity Sdctrament Tariff SberiS 

Cruelty Altar Naturalization Perjury 

Revenge Monastery Consul Embemenieni 

Envy Bishop Regent Blackmail 

Patriotism Easter Quorum Forgery 

Duty Trinity Treaty Bail 



Mechanical 

Pulley 
Plow 
Scythe 
Rudder 
Piston 
Forge 
it Dynamo 
Insulation 
Derrick 
Semaphore 



Industrial Commercial Recreatk>nal Domestic Public 



Piece-work 

Fk)or-walker 

Corporation 

Line-man 

Broker 

Strike-breaker 

Boycott 

Stoker 

Foreman 

Rake-<^ 



Bank 

Check 

Credit 

Pawn 

Mortjgage 

Auction 

Contract 

Bankruptcy 

Discount 

Lease 



Ace 

Dice 

Short-stop 

Touch-down 

Jockey 

CuebaU 

Odds 

Lager 

Stogy. 

Rag-time 



Oven 

Yeast 

Flue 

Sirlcnn 

Borax 

Thimble 

Dimity 

M(^ 

Tape 

Eaves 



Post-card 

Telegram 

Amoulance 

Steerage 

Editor 

Insurance 

Vaudeville 

Taxi 

Penskm 

Militia 
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quiry of doctors, social workers — and also patients — there, 
and by newspaper reading. It is by no means as satisfactorj 
as might be desired, and a double meaning for several of the 
words has been discovered; but it seemed imwise to try to 
improve it further without trial in definite form. The writer 
at first wavered between two methods in selecting the words. 
It was possible ( 1 ) to try and obtain words, within each field 
of information, which any intelligent person of fair general 
information should know. Or, (2) the list might be made up 
of words which only an individual especially conversant with 
that field would be able to define. If the list were made up in 
this last way, and used either as an information or a free 
association test, it might well have some detective value — 
might bring to light a hidden interest in unfortunate subjects, 
perhaps. With the formation of such a list in view the writer 
for some weeks carried a special pad of paper on which he 
jotted down all the highly special words which he could ob- 
tain from interviews with various unsavory characters ap- 
pearing at the hospital, and with street-car men, clerks, sailors, 
mechanics, and others having their own special supply of odd 
words. But it was finally decided that the fifst concept was 
the better: the second basis of selection would lead to a list 
of very limited usefulness. 

2. Results. As a test of general ability and a check on the 
results of Terman's vocabulary test (the use for which the 
list was first intended) the value of the list would best be 
demonstrated by data from children of the poorer classes or 
from adults of little schooling; such cases might be expected 
to do very poorly with the Terman words, but to give results 
with the writer's list much more in keeping with their mental 
age. The writer has been unable to obtain any systematic 
data of this sort, but has instead tried to investigate (a) the 
value of the list as it may be used with average school chil- 
dren, and (b) its usefulness as a means of studying differ- 
ences in interest and special information. In investigating the 
first problem the Terman list of words, and the 100 words of 
the above list, were given as a group test to 56 children in the 
fifth grade in two schools in Bloomington, Indiana. It was 
desired to find out (1) the most satisfactory method of scor- 
ing, (2) the correlation of results from the two lists with some 
independent measure of general ability, and (3) the extent 
of the ^)ecific contribution made by each list to the correlation. 

Two methods of scoring the results were used. In the first 
place, they were scored according to Terman's rulej one point 
being allowed for each word which was defined with la degree 
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of exactness sufficient to indicate some knowledge as to its 
meaning. That is, scoring was very lenient and no partial 
scores were allowed.. The results were then gone over a 
second time, a score of 1 being given for a bare indication of 
acquaintance with the word, and two points being allowed 
when the word was correctly defined. The correlation of the 
results with the practical information test, scored in these two 
ways, was .86. The correlation for the Terman list was .84. 
These correlations, of course, suggest strongly that it makes 
little difference which method of scoring is used. 

Results were now correlated with findings from a group 
scale of general intelligence given to these same children a few 
months previous.' The correlation of the practical informa- 
tion test, scored in the first way mentioned, with these ratings 
was .40. The correlation, scored in the second way, was .45. 
The results would suggest that the more exact method of 
scoring might be expected to give more significant results. The 
Terman list scored in this last way was now correlated with 
the scale. The correlation was .50. Apparently for school 
children (if we may generalize from these results) Terman 's 
list is slightly better as a test of general intelligence ; a result 
which surprised the writer, but of course, does not affect the 
question as to the relative merit of the two lists for the special 
purpose already mentioned.^ A higher correlation in both 
instances would be expected from older children, since results 
from older children would be less affected by irrelevant cir- 

* Pressey, S. L. and L. W. A Group Point Scale of General Intelli- 
gence. Journal of Applied Psychology, Vol. II, 1918, pp. 250-269. 

^ Whatever the comparative merh of the two tests for any of these 
purposes, the Practical Information test is at least vastly superior in 
th« number of extraordinary ideas it brings to Hgfat. In the present 
experimentation the Terman list resulted m only one mild epigram: 
hysterics is " sick in your head.'' But with the writer's list such gems 
abound. To pawn is to " sell things temporarily ; " credit is ** to pay 
for something some other time ; " a mortgage is ** when another person 
can take what he wants off you." Larceny is "stealing things that 
don't amount to much : " cheating is " to take money from people who 
can't count good." The religious terms bring out vividly the pre- 
vailing cynicism among the younger generation : an altar is " an object 
on which sacrifices were made in old times — in use now ; " and Easter 
" is the day on which Christ was supposed to have risen! " Two curi- 
ous bits of etymology also appear nere: a disciple is "when it is not 
coupled together." and a bishop is "the owner of a shop." Yeast is 
" put into bread to make it grow." A floor-walker " quiets the baby ; " 
rag-time is " bouncy music" An editor " puts the news into the news- 
papers." A boycott is " a boy that has a uniform on and will be a 
soldter some day ; " patriotism is " to be kind, and put out a garden." 
The finding of such choice bits gives a real zest to the labor of sooring. 



Digitized by 



Google 



378 PRESSEY AND SHIVELY 

cumstances such as differences in ease of writing. But since 
the children were allowed all the time they needed there is no 
reason to suppose that any special difficulty in writing or in 
expression played any very serious part in the results. 

A mild effort at partial correlation resulted in a correlation 
of .78 between the two lists, r j,.j was found to be .26 and 
r 12.3 was .11, the first variable being the group scale, the second 
being the practical information test, and the third the Terman 
vocabulary. Apparently the practical information test does 
make its own contribution to the correlation. Correlation with 
an individual examination such as the Binet, and oral defi- 
nition for both lists, would, of course, be much more valuable. 
However, the above figures will give some rough idea as to 
what might be expected in general of the comparative cor-, 
relation of each informational test with ratings of general 
ability. 

An effort was next made to discover whether clear differ- 
ences in knowledge of special fields might be found by means 
of the practical information test. Analysis by sex was first 
tried. In making this analysis data from the 56 fifth grade 
children already mentioned was combined with results from 29 
eighth grade children. The median for the boys in each group 
of ten words, for each grade, was found, the number of girls 
above this median counted, and the total number of girls above 
the median expressed as a per cent of all the girls tested. The 
results were as follows : 

Word Group^ 123456789 10 

Per cent girls above boys 

median 505025 17 20255020 6158 

There are here clean-cut sex differences. The girls ar<j dis- 
tinctly superior in knowledge of the " domestic group " of 
words, and slightly superior in the list having to do with 
public utilities and information of that same general nature. 
Boys are superior in knowledge of the " governmental '* Words, 
of the legal and mechanical words, and also of those having 
to do with recreation. 

A comparison of the fifth and eighth grade was also tried. 
But it was impossible to find any definite difference in increase 
of knowledge along different lines. The children in a small 
colored school were next given the list, a total of 36 children 
in all. Of these 14 were in the fifth grsidt, 15 in the sixth, 
6 in the seventh and 1 in the eighth ; the group was, therefore, 
lumped and compared with the results from the fifth grades. 
The per cents of colored children scoring above the miedian . 
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for the white children, in the ten groups of words, were as 
follows : 

123456789 10 
P^Cent: 45 56 81 56 19 80 81 81 72 80 

To the writer, at least, the results are distinctly surprising. 
The colored children average about 1 grade above the white 
chidren and over two years older. Nevertheless, they show 
a poorer average knowledge of moral terms, about the same 
acquaintance with religious terms. They show what might 
almost be called a total lack of acquaintance with the general 
vocabulary of mechanics. With the small number of cases 
these results should, of course, not be made too much of; it 
should be remembered also that the words are graded in only 
the most rough fashion and the test otherwise loosely organ- 
ized. But it may at least be said that the results are suggestive. 
The writer cannot but believe that the races differ in the ten- 
dency of their interests; and he feels decidedly that a valuable 
way to investigate such a matter is to measure the information 
acquired along various lines.* 

3. Discttssion, A word remains to be said on these few 
findings. They surely suggest fundamental differences, as re- 
gards information and interest, between the sexes and between 
the two races. The writer feels strongly that until we know 
more about differences in interests we cannot know what we 
should with regard to sex and race differences. The tendency 
is to investigate such matters by somewhat isoteric and round- 
about methods. We use the free association test, for ex- 
ample, act mysterious, employ a stop-watch, and otherwise 
embarrass the subject. A straight-forward investigation of 
information might very well, in such instances, bring the same 
data with no difficulties of cooperation. As one method of 
investigation the writer would like to suggest such lists as 
those above. In its present form the test here described is 

^ It should be stated that in making these analyses the second method 
of scoring was used, that is, a child might get a zero, one, or two, on 
each word. As indicative of the general fall of the figures it may 
be added that the. median for the fifth grade, when the practical in- 
formation test was thus scored, was 42.5; for the eighth grade it was 
106 (out of a total possible of 200 points). The fifth grade medians 
for the separate groups were as follows: 

1 23456789 10 

12 321504085 

For the Eighth: 18 11 12 5 11 6 12 9 14 17 

The fifth grade was composed of 37 girls and 29 boys; the eighth grade 
group of 14 girls and 16 boys. 
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obviously not satisfactory; it is not adequately organized, it 
is hard to score and awkward to handle ; but it seems to have 
very good possibilities as a method of investigation. It may 
have a practical value too. But the writer has been diverted 
from that matter by the research interest of the data. He 
hopes to have further material to offer later. 
4. Summary. The paper may be briefly summarized; 

1. It is argued that an " unselected " vocabulary test is un- 
fair to delinquents and to adult cases of little education. As 
a substitute a selected vocabulary covering certain fields of 
common information is offered. 

2. A comparison of this test with Terman's vocabulary test 
is made. It is found that fifth grade children give results, 
correlating more highly with findings from a group scale of 
intelligence, with the Tcrman vocabulary test than with the 
writer's information test. 

3. Distinct sex and race differences in the various fields of 
information are found. 

4. It is suggested that such a test offers a convenient method 
for the investigation of sex and racial differences in interest. 
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The " Efficiency " of a Group Scale of Intelligence 
IN Prognosticating Success and Failure in 
Junior High School 



By S. L. Pbessey 



1. Problem and Materials. The paper deals with the prog- 
nostic value of a group scale of intelligence previously de- 
scribed in this Journal,^ for forecasting success or failure in 
Junior High School. This scale was given in March, 1918, 
to all the children in the sixth grade (the entering grade) of 
a large Junior High school — a total of 165 cases. In the fall 
of 1919 the subsequent school history of these cases was in- 
vestigated. Of the original number 20 cases were found 
to be lost to the study, because the family of the child had 
moved away, or for other similar reasons having no connec- 
tion with school standing (cases leaving school because of 
school failure have been included in the study, as will be 
described below). For each one of the remaining 145 children 
the school marks for June, 1918, January (semesters) 1919, 
and June 1919 were obtained. The paper has to do with the 
relation between these marks and the test scores. 

Two questions have been put: (1) What test scores were 
made by those children who failed in school (that is, using the 
school's own definition, those children who obtained marks 
below 75 in three or more of the four " promotion subjects " 
—arithmetic, geography, history, language) ? (2) What is 
the relation of test scores to later success in school as shown 
by the last available marks (June, 1919), or when this class 
as a whole had completed the seventh grade? In each in- 
stance the effort has been to present the findings in terms that 
would be readily interpretable for use in individual diagnosis ; 
in fact the interest of the writer has been rather in these 
methods than in the particular results dealt with. 

2. Results: (a) Prognosis of School Failure. For the 
purpose of studying the relation between test score and failure 
in school the distribution of test scores for the 145 cases was 
divided into ten parts by calculating the deciles throughout. 

^ Preste^, S. L. and L. W. A Group Point Scale for Measuring Gen- 
eral Intelhgence, Journal of Applied Psychology, Vol. II, 191^ pp. J69- 
287. 
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The number of failures scoring in each decile was then de- 
termined. The results run as below. As has already been 
said, the tests were g^ven in March, 1918. The first row 
below gives the number and distribution of failures for June, 
1918; the second row gives the same facts for January, 1919, 
and the third row the data for June, 1919. The last row sum- 
marizes by giving the position of the scores of all the children 
who failed during any one of these three terms. 









Decile Division 




Toti 


Failed: 

June 1918 

[an. 1919 

June 1919 

All Mures 


1 

9 

6 

9 

11 


2 

6 
4 
6 
9 


3 4 5 6 7 8 

3 12 11 
3 110 1 
2 4 10 2 
5 4 2 12 


9 10 


2 

1 1 

2 1 


23 
18 
26 
37 



It should be added that this final row does not count any 
child twice, but shows the number failing at any one or all 
of these three terms. It should also be said that the 1919 
rows include as failures those who failed in June, 1918 and 
left school because of the failure. 

Perhaps the most striking thing about these results is the 
bimodal distribution of the failures. The vast majority of 
the children who fail tested well at the bottom of the distribu- 
tion. But there is another small group near the top. There 
is a suggestion here of a maladjustment not only between dull 
child and school, but between school and superior child as 
well — perhaps some of the brighter children do not find 
sufficient stimulus to their abilities in the routine school work 
of their " normal grade." Anyhow, this little group of failures 
who test as above average in ability is distinctly interesting. 

The matter is, however, somewhat aside from the problem 
in hand. The practical problem is this : What indication can 
be obtained, if such an examination be given to children in 
their first year in Junior High. School, as to those pupils who 
will later fail in their school work? For such a practical 
diagnostic purpose the writer would like to suggest the fol- 
lowing table, which is simply the last row of the table above, 
expressed in terms of per cent of the number of cases in each 
percentile division who were failures. 

Decile Division 

123456789 10 
Ptr cent, failing, or-yper cent 
probability that a given case 
ivill fail 76 62 35 28 14 7 14 14 7 
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Thus there were 11 failures in the first decile division; there 
were a total of 14.5 cases in each decile division, — and 11 is 
76% of 14.5. The other per cents were similarly found. The 
table shows the incidence of failure throughout the entire 
distribution of test scores. It is also, however, readily inter- 
pretable for purposes of individual diagnosis. Suppose a 
principal gives the scale to the entering class in his Junior 
High School during their first year. He may assume (if the 
school from which the writer's data is taken may be considered 
reasonably representative) that if a given child scores below 
the ten percentile for the grade there is a 76% probability that 
that child will, within the next two years, fail at least in one 
semester of work. If another child scores between the thir- 
tieth and fortieth percentile there is a 28% probability that 
that child will fail — and so on for the other decile divisions. 
The method is direct and obvious, and would seem of some 
general usefulness.* 

(6) Prognosis of School Attainment as Measured by 
School Marks, In order to obtain some more general indica- 
tion as to the relation of test scores to future school accom- 
plishment the relation of these scores to the marks obtained by 
all the children in June, 1919 — almost a year and a half later 
— was studied. The median mark of the marks obtained, 
at this time, by each child, in the five subjects arithmetic, 
reading, grammar, history, and geography, was used to repre- 
sent school success. And a correlation was run between these 
median marks and test scores. The correlation was found to 
be .50. 

However, — as has been well pointed out recently' — sl 
correlation coefficient is a very inadequate way of presenting 
such data for purposes of individual diagnosis. In order to 
obtain a statement more satisfactory, for such a purpose, the 
scatter diagram from which the correlation was plotted was 
divided into five parts each way, by ruling lines through the 
20, 40, 60, and 80 percentiles of each distribution. And the 
table was made to read as for 100 cases, by expressing the 
number in each compartment of the diagram as a per cent of 
145 — ^the total number of cases. The result was as follows: 
(I being best and V poorest in each array) : 

* A somewhat different application, and to a psychiatric problem, has 
been made in a previous article, "Irreffularity as a Measure of De- 
terioration " Jour, of Abnormal Psychology, December, 1918. 

*Thurstone, L. L. "Mental Tests for College Entrance," Jour, of 
Educ. Psychol,, Vol. X, 1919^ pp. 129-42. 
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Division Into Fifths— Test Scores 
V IV III II I 



Division I 








2 


5 


13 


into II 


1 


4 


4 


8 


3 


fifths- III 


4 


4 


5 


4 


3 


school IV 


7 


6 


5 


1 


1 


marks V 


8 


6 


4 


2 






If, now, the hypothetical principal above mentioned has 
given the scale to his sixth grade, and finds that a partictilar 
" problem case " scores in the upper fifth of the class, he may 
conclude that the probability is 13 out of 20 that that child will, 
at the end of the next school year, be receiving maiics which 
place him in the upper fifth of his class. There is only 1 chance 
in 20 that this child will be marked below the middle group. 
There are chances out of 20 that the pupil will appear in the 
poorest fifth, in school grades, — and so on.* The method is 
direct, readily understood by teacher or principal; and not 
only the probable diagnosis, but also something as to the defi- 
niteness of the indication, is shown. 

As with the previous method, a larger number of cases is 
necessary to make the table reasonably reliable — ^the ideal form 
would probably involve decile divisions, the table then reading 
as for 1000 cases, or 100 in each array. But the writer feels 
that the methods themselves shotdd be of distinct practical 
value, particularly in dealing with the very concrete and 
definite prognostications of business and vocational psy- 
chology. 

3. Discussion, A word remains to be said with regard to 
such use of school marks, and school failure, as criteria in 
terms of which to evaluate tests of "genend intelligence." 
It might be argued that the peculiar value of such tests was in 
in their ability to get beyond the particular narrow set of facts 
by which school marks are usually determined. And the til- 
timate criterion becomes — what the child would do, in a sys- 
tem highly adaptable to individual differences. But we also 
may wish to know what children, things being as they are, 
will fail next year, a year later ; we may wish to know the chil- 
dren now in the eighth grade who will fail in high school 

* It should be said that eight cases leaving school because of failure 
in June, igiS have not been included in the correlation. Strictly speak- 
ing, they should be, somehow, probably at the bottom of the distribu- 
tion of marks; our hypothetical principal does not know in advance 
who is going to leave school and should be provided with a prognosis 
table, covering all the cases under consideration But for present pur- 
poses the omission of these eight cases may be considered negligible. 
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should they go there, the college entrants who will fail their 
Freshman work. It may very well be that for prognosis over 
a brief period, in a situation such as is dealt with in the 
present paper, a set of achievement tests would give a more 
definite indication than tests of more general content; the 
writi^r hopes soon to present data bearing on this point. The 
study of such very concrete and rigidly defined problems is 
certainly much needed; such study would appear the only 
empirical and scientific way of determining the validity of the 
concept of " general intelligence "—that is, the validity of the 
theory that prognosis problems can be generalized. 

4. Sumfnary. 1. The paper deals with scores obtained 
from the sixth grade children of a large Junior High school, 
and with the school history of these children for three semesters 
since the tests were given. A definite statement of the prog- 
nostic value of the tests, over this period, b sought. 

2. A numerical statement is obtained of the probability of 
failure in school implied by scores at various points on the 
distribution of test scores. 

3. An analogous statement for prognosis of marks, over 
one year, is presented. 
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James Burt Miner. Deficiency and Delinquency, An Interpretation of 
Mental Testing, Warwick and York, Baltimore, 1918, p. 352. 

The author here presents a comprehensive study of mental testing 
as applied to deficients and delinquents, assembling from a vast body 
of literature the various conclusions thereto appertaining. As the titie 
suggests, the study is an interpretative one. We may add that it is 
also a wholesome critique. His claim to greater practicality in diis 
important field of psychology is verified throughout, as there is shown 
to be a place for the serious attempts of social welfare workers, teach- 
ers, and amateurs, as well as the trained, clinician. 

Heretofore, the great complexity of the problems of deficiency has 
not been adequately solved by the employment of objective or qualita- 
tive tests alone, since the results have always been vitiated by certain 
errors necessarily connected with examinations. While the earlier 
objective tests have contributed much to basic data, and while they are 
sufficiently accurate to serve as a check to empirical judgment respect- 
ing obvious cases of deficiency, they are relatively worthless for the 
diagnosis of that larger group of borderlines, the accurate testing of 
which alone determines Sie true value of a test The central theme 
and purpose of the study is, therefore, to set forth and explain the 
requisites of a system of tests which will serve to diagnose the trouble- 
some "borderline" cases. The need of redefining the borderlines of 
deficiency becomes obvious to the author through practical experience 
with deficients in the Minneapolis Juvenile Court. Valuable data is 
also gathered from the Glen Lake Farm School for juvenile delin- 
quents. As a further background for this study, the author has had 
the advantage of visiting scores of institutions in Austria, England, 
Switzerland, Germany, France, and Italy. To all this may be added 
Uie author's knowledge gained through the stud^ of law, and the legal 
problems now fast becoming coextensive with social problems. 

Accepting the common conception of feeble-mindedness, which holds 
it to be a lack of development rendering the individual socially de- 
ficient and requiring constant supervision or guidance, and excluding 
. from this category the so-called "conative" cases of deficiency, the 
author's contribution may be summarized as follows : 

1. Deficiency and delinquency are not mutually inclusive. Deficiency 
may be regarded as a state of permanent undevelopment, while delin- 
quency may or may not accompany it. In order to eradicate subjective 
opinion in the differentiation of the two, a conservative borderline on 
the basis of Binet pr other tests, should first be established, so that 
treatment of the delinquent is assured a still further individual con- 
sideration. 

2. Present-day tests are inadequate for reliable diagnostic purposes, 
since they tend to exaggerate qualitative differences among abnormal 
subjects. Deficiency may now properly be looked upon as a relative 
and "quantitative" condition; every degree and shade of undevelop- 
ment is the rule. 

3. The number of defectives in proportion to die school and general 
populations have been variously estimated ; and these estimates indicate 
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something of the illusory and unscientific nature of tests and their 
interpretation. Therefore a ''percentage definition of tested deficiency 
is suggested for determining the borderline below which an individual 
may be presumed to be so deficient as to justify isolation." The most 
conservative estimate of the number of defectives may now be said t6 
be : *' Those who would at 15 years of age be in the lowest 0.5% in 
tested ability among a randomly selected group, may be presumed to 
be so deficient as to justify isolation. Above them the next 1.0% may 
be regarded as uncertain, since the bulk of them would require some 
supervision or guardianship during life." The verification, of such 
borderlines may be regarded as the main contribution yielded from die 
new data here studied. 

4. Pfactically speaking, the location of borderlines on a test scale is 
symptomatic only, since different communities offer different results. 

5. Emphasis should be placed on the social significance of deficiency 
both in its diagnosis and ultimate results. Deficiency and delinquency 
should therefore be referred to a commission consisting of expert 
medical and psychological assistants, so that conative cases may not 
be unjustly retained in public institutions permanently. To this end, 
a " temporary home school " is advisable. 

6. L^l definitions of the criminality of deficients should be so 
changed as to obviate all subtle questions of mental analysis, such as : 
** was laboring under such a defect of ceason as not to know the nature 
and quality of the act he was doing or know the nature of the wron^ ** 
(New York Law). Such law places too much emphasis upon the m- 
tellectuality of the accused, whereas in most cases of delinquency, the 
crime is more closely related to the emotions. The problem of crim- 
inality is a ** problem in the treatment of hereditary diathesis in which 
the mental deficiency is the largest factor." 

7. Whether society should adopt a policy of sterilization, or that of 
isolation, by force or consent, is an open question. At present it ap- 
pears to be a question which may well await the perfecting of develop- 
mental tests that may assure accurate diagnosis. But wherever the 
cases are obviously permanently deficient, isolation is advisable for 
girls and women of child-bearing age. 

8. External influences, such as criminality in the home, character and 
amount of education, standards of living, etc., seem to be less im- 
portant than is heredity. 

9. The schools have in all cases of deficiency, a special work to do 
in the discovery of such pupils, and in the referring of the same to 
the proper authorities. The school may also do a great deal in gather- 
ing data relative to the various correlations of conduct and mental 
attainment, which so far have been relatively unscientific. 
University of Vermont. J. W. Sprowls. 



Sherwin Cody. Commcrciah Tests and How to Use Them, School 
Efficiency Monographs. World Book Co., 1919. 
The author presents valuable tests for determining ability to perform 
fundamental operations in business offices, viz., tabulation, reproduc- 
tion and following of instructions, elementary invoicing, elementary 
arithmetic, elementary English, business letter writing, steno^aphy, 
typewriting, penmanship and filing. These tests are in line with the 
tendency to test specific abilities and have the further qualification of 
being short They have been standardized by use among thousands of 
grammar school and high school graduates and office employees of 
several large business houses, the average performances in the several 
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tests being given for each group. However, in giving these norms the 
author fails to add any measure of variability, thus detracting ma- 
terially from the scientific and practical value of his woiic 

The author's use of the expression "business ability" to describe 
these tests is possibly misleading. They do not test business capacity 
but rather achievement and are therefore classifiable with educational 
or proficiency tests. Used alone they have rather limited value for the 
prospective employer, since they give no indication of an individual's 
future value as an employee nor of his ultimate vocational fitness for a 
business position. General intelligence, learning ability, habits of in- 
dustry, etc., must be obtained from other sources or be assumed to 
correlate highly with the scores in the tests. However, improvement 
rate in a series of tests, together with school marks and teachers' rat- 
ings, could be used successfully by employers for selecting employees 
who have a high degree of capacity. 

One test in the series, the Tabulation Test, is called an ' intelligence ' 
or * mental alertness * test This amounts to stretching the conception 
of intelligence tests rather severely, but the statement is in line with 
the author's contention that a "high degree of accuracy in figures, 

, is an evidence of mental capacity," and shows "a dis« 

cipline in mental control which must carry over into all the activities 
of life." Even if this statement is accepted it cannot be assumed that 
the reverse is equally true, for high mental capacity and intelligence is 
possible and frequent where ability to use figures with speed and ac- 
curacy is lacking. 

An outstanding feature of the book is the method used for grading 
and checking the tests in the schools. The pupils themselves do the 
checking. This makes for speed and, in the author's opinion, gives a 
sufficiently high degree of accuracy. For example in New York, in 
1917, ** the tests were given to 6,000 eight-grade pupils, three tests to 
each. The margin of points overlooked or wrongly marked was not 
sufficient to change the median for any class as much as one per cent" 

A gross error appears in the form of directions for giving the tests 
(pase 57) • " Tell pupils they must be as careful not to get too high a 
mark as not too get too low a mark, for then on the next test they will 
not show the improvement which is equally important with a high 
grade to start with." ^ 
Carnegie Institute of Technology, Pittsburgh, Pa. H. C. Kenacy, 



William Fretz Kemble. Choosing Employees by Mental and Physical 
Tests. The Engineering Magazine Company, New York, 1917, 
p. xiii+333. 
The purpose and claim of the book is perhaps best expressed in the 
author's own words: "The following pages reproduce a series of 
tests which not only will pick out the man of great capacity from 
among a mixed company undergoing the test, but will arrange a stafiF 
of men in the approximate position of their ability when certain 
weiglits are assigned according to the nature of their work." This 
claim seems totally unsupported by results. Kemble not only does not 
prove in any way that his tests will do what he claims for tkcm if 
handled by an experienced man; but he gives no accurate and sufE- 
ciently detailed instructions; therefore if the tests were given by an 
inexperienced man, there would be no hope of their receiving a proper 
evaluation even were the tests adequate, which we believe they are not 

1 Review approved by the Committee of the American Psychological 
Association on Publications in Applied Psychology. 
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For example, Kemble nowhere states how he has standardized his 
tests. In several cases he gives the ** human average " but says nothing 
of how this average was obtained. He suggests a psychog^m of the 
subject, but does not indicate how this psvchogram can be evaluate 
by the business man. And what is equally important, he does not 
seem to recognize any limitations to tests, nor does he differentiate 
between the precision of different tests, being willing to give an exact 
score in spelling ability and an equally exact one in honesty. 

In order to so estimate a man's ability, Kemble would use four 
sources of information. The inadequacy of these is apparent to any 
one who understands the laws of testing. They follow: 
I. An employment blank, consisting of five parts: 

a) a personal history blank 

b) a financial statement 

c) an expenditure blank 

d) a questionnaire concerning the religious and moral life of 
the person 

e) a personal belief blank 
II. The " Peg Board Tests." 

III. A series of mental activity tests. There are twenty-one of these 
tests, most of them of the ordinary type: memory for sense material, 
etc. However, a few are of rather an exceptional nature. The p^cneral 
information test consists of a series of questions, the information for 
answering which would be most apt to be picked up among day labor- 
ers — for example: "Give the proportions used in making mortar." 
The ethical test has questions similar to the following: "If you were 
about to take a trolley and a friend got off a car and offered you a 
transfer, would you use it? " The personal opinion test is rated in an 
original way; the answers to the questions are decided by the vote of 
at least ten high-class executives. The test then is supposed to differ- 
entiate between the executive and the popular type of mind. One's 
honesty is rated by the number of the following questions that he 
answers by "Yes" : "Do you smoke? Do you drink? Do you 
use slang? Do you swear? Kemble's method of using these tests 
is to decide what elementary qualities are involved in any occupation 
for which he is testing applicants, pick the tests which test these quali- 
ties and sum them for the applicant's score for that occupation. Any- 
one at all familiar with testing realizes at once the danger of such a 
proceeding. 

IV. A study of the physical characteristics of the subject, type of 
face, length of fingers, etc. 

In general, Kemble has made a rather unique collection of tests. A 
few hsLve new features which perhaps offer ideas, but his claim of 90 
per cent accuracy and the lack of standardization makes the book of 
little value for practical purposes, and even pernicious if used by an 
inexperienced person.* 
Carnegie Institute of Technology, Pittsburgh, Pa. M. A. Bills. 



Frederick Schleiter. Religion and Culture, A Critical Survey of 
Methods of Approach to Religious Phenomena, Columbia Uni- 
versity Press, New York, 1919, p. 206. 
The subtitle of the book should be borne in mind when one is read- 
ing it. It is the methods of approach to religious phenomena that the 
author is discussing. And the first method taken up is that propounded 

1 Review approved by the Committee of the American Psychological 
Association on Publications in Applied Psychology. 
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by Buckle, the studying of limited areas intensively and then drawing 
general conclusions from the results obtained. This method "bristles 
with fallacies and insupportable presuppositions, the most obvious and 
far reaching of which embodies the idea that the ethnographic phe- 
nomena found in some specially selected area, are the result of an in- 
dependent development, and constitute, as it were, an indigenous entity 
possessing complete historic individuality" (p. lo). 

The comparative method which consists " in bunching of static facts 
to indicate the common properties of primitive mind," . . . " has 
served to bring tc^ether similar customs, rites and ideas the world 
over, to stimulate investigation of them and has, in many cases, laid 
the basis for their elucidation'' (pp. 21, 27). But it should be remem- 
bered that all genealogical hypotheses "lack objective confirmation 
and that their relative merit is to be judged largely on the ground of 
obvious plausibility and ingenuity" (p. ^). 

The framing of ethnographic analoga the author characterizes as " a 
somewhat romantic procedure" (p. 67). 

Animism and the mana theorists are equally incompetent to solve 
the problem, since the former "is far from literally true" (p. 80), and 
the latter "are full of inconsistencies, obscurities, and ambiguities" 
(p. 123). The discussions of animism and mana are very interesting 
and instructive. 

The role that the concept of causality has played in religion and cul- 
ture is truly great. This very obscure and ambiguous concept has 
lately come in for a great deal of criticism, and some scholars have 
gone so far as to suggest that it be rejected altogether. Mach says: 

There is no cause nor effect in nature; nature simply has but an 
individual existence; nature simply is" (p. 142). Russell, *who is 
perhaps one of the most severe critics, points out that "in advanced 
sciences such as gravitational astronomy, the word 'cause' never oc- 
curs" and that the ''concept is not employed at all nor does it find 
embodiment or asylum in the algebraic equation" (p. 144). "Fiske 
characterized the development of science as a progressive ' de-anthro- 
pomorphization ' and Comte supposed that the evolution of society in- 
volves the continuous elimination of ' fetishistic ' elements " (p. 146). 

Lastly the author discusses "the convergence of mental processes 
which lead to the attribution or predication of a dynamic relation be- 
tween two or inore elements" (p. 153). In this connection he calls at- 
tention to Dresslar's work on superstition among persons "profes- 
sionally trained for the work of teaching." This work shows that 
44.9 per cent believed either wholly or partially in certain supersti- 
tions. But " neither the character of the connecting link nor the man- 
ner of the achievement of the results appears in the tables" (p. 157). 
In another connection the author points out that "in many cases^ he 
does not know precisely how these events, objects or processes are 
connected, — in other words, the nexus does not rise into his con- 
sciousness" (p. 161). 

But there is not only an unconscious acceptance of the articulating 
mechanism, there is also to be found " a highly conscious and rational- 
istic enquiry in which the mind attempts to grasp, by acts of deliberate 
apprehensions, the causes of an event and then launches out boldly 
upon a more or less boundless path" (p. 164). Several interesting 
illustrations are here produced, both among primitive men and men of 
our own time, all of which go to show that an " enormous range and 
diversity of mental processes are involved in causation" (p. 191). 

The purpose of the book is to " suggest that these logical processes. 
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which lift facts out of their indigenous habitats and deal with them in 
their universal aspects, should be applied with more critical caution 
than is customary'' (p. 193). The positive contribution of the book is 
naturally not as great as the negative. But it constitutes a good criti- 
cal survey of the field it covers and is therefore a valuable contribu- 
tion to the literature on this subject. 

Karl J. Karlson. 



The following publications have been received : ^ 

James Winfred Bridges. An Outline of Abnormal Psychology, 
R. G. Adams and Company, Columbus, O., 1919. 

W. J. Crawford. Experiments in Psychicaf Science, Levitation, Con^ 
tact, and the Direct Voice. E. P. Dutton and Company, New York, 
1919- 

L. M. GiLBRETH. The Psychology of Management, Sturgis & Walton 
Company, New York, 1918. Reprinted without dhanges from 
1914. 

Henry C. Link. Employment Psychology, The MacMillan Con> 
pany, New York, 1919. 

NoRAH H. March. Towards Racial Health, E. P. Dutton & Co., New 
York, 1919. 

Daniel Starch. Educational Psychology, The MacMillan Company, 
New York, 1919. 

Lewis M. Terman. The Intelligence of School Children. Houghton 
Mifflin Company, Boston, 1919. 

Margaret J. Hamilton. Psychological Analysis and Re-education, 
with Case Studies, Reprmted from The Journal of Educational 
Psychology, Feb., 1919. 

M. Laignal-Lavastine. The Internal Secretions and the Nervous 
System. Trsl. by F. T. Robeson. Reprinted from Nervous and 
Mental Disease Monograph Series, No. 30, 191 9. 

S. D. PoRTEUs. Cephalometry of Feeble-Minded. Reprinted from the 
Vineland, N. J., Training School Bulletin, June, 1919. 

. Porteus Tests — The Vineland Revision. Reprinted 

from the Vineland, N. J., Training School Bulletin, No. 16, Sep- 
tember, 1919. 

Arthur H. Sutherland. Ungraded Rooms in Los Angeles City 
Schools. First Annual Report, Division of Psychology, Year end- 
ing June 30, 1919. 

J. E. Wallace Wallin. Meeting the Needs of the Mentally Handi- 
capped Child in School. Reprinted from Ohio Bulletin of Charities 
and Correction, June, 1919. 

* Mention here does not preclude further comment 
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The Field of the Clinical Psychologist and the Kind 

of Training Needed by the Psychological Examiner, Reprinted 
from School and Society, April 19, 1919. 



. The Achievement of Mental Defectives in Standard^ 

ised Educational Tests, Reprinted from School and Society, 
Aug. 29, 1919. 

J. Harold Williams. The Intelligence of the Delinquent Boy, Re- 
printed from Journal of Delinquency, Monograph No. i, 191 9. 

CARitY On, A liagazine on the Reconstruction of Disabled Soldiers 
and Sailors, Vol. i, No. 10, July, 1919 (probably the last isssue). 

Revista dk Psiquiatria. Lima, Peru, Vol. 2, No. i, July, 1919. 

Revista de Educacion. Santo Domingo, R. D. Vol. i, Nos. 3 and 4, 
1919. 
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A special committee of the National Research Council, consisting of 
Dr. R. M. Yerkes, chairman, and Dr. M. E, Haggerty of the Univer- 
sity of Minnesota, Dr. L. M. Terman of Stanford University, Dr. 
E. L. Thomdike of Teachers College, Columbia University, and Dr. 
G. M. Whipple of the University of Michigan, with financial support 
from the General Education Board, have formulated a plan for using 
the army mental tests in schools. Such intelligence tests have been used 
in schools for some time on individual children, but the new plan pro- 
vides for handling them in groups, even whole class-rooms at a time. 
The committee selected about twenty tests for careful trial. This trial 
was made on five thousand children. As a result the committee has 
now been able to select from the tests two series which seem to be the 
most satisfactory and these will now be tried on several thousand 
more children in order that they may be further perfected before they 
are finally offered to the teachers of the country for general use. 

This carefully worked out program for group tests will make it 
possible and practicable to make wholesale surveys of schools annually, 
or even semi-annually, so that grade classification and individual edu- 
cational treatment can be adjusted with desirable frequency. It is 
expected that the methods will be ready to be published for genera^ 
use early in 1920. The army tests on which these new group tests for 
children are based and which were used with striking success and 
advantage during the war, were originally devised by a group of psy- 
chologists working under the auspices of the National Research 
Council. 



The following statements are extracted from a report by Vernon 
Kellogg of Leland Stanford Jr. University published in The Nation's 
Business, November, 191 9. 

"The lesson of the war as regards science, then, is first, that the 
efforts of scientific .men can be greatly speeded up by a proper stim- 
ulus; second, that these efforts can be made immensely more effective 
and fruitful by a proper organization; and, third, that while such an 
organization can be encouraged and helped by the Government, it can 
be effected by cooperative effort among scientific men themselves. 

"The founding of the National Research Council is the outgrowth 
of this lesson. And the special characteristic — and a truly American 
one — which distinguishes it from the other rather similar organizations 
of England, Canada, Australia and Japan, and also from the already 
long-established government scientific bureaus of our own country is 
that, although officially recognized by the Government, it was not 
initiated or organized by it and is not supported by it. It is the out- 
come of a nation-wide cooperative effort of the scientific men of 
America, including representatives of the universities, the various 
special privately endowed research institutions, the scientific labora- 
tories of the great industries and the Government scientific bureaus, 
and the numerous unattached specialists. And it is entirely controlled, 
in a thoroughly democratic way, by these many cooperating scientific 
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investigators. It derives its support from funds contributed from 
private sources. 

The Council is organized primarily as a permanently constituted part 
of the National Academy of Science. 

"Effective prosecution of the Council's work requires not only the 
cordial collaboration of scientific and technical men of the universities 
and special research institutions all over the country, but also those 
connected with the scientific and technical branches of the Government 

"As now organized^ the National Research Council has permanent 
headquarters in Washington, with an executive staff of scientific men 
giving their whole time to the work of their respective positions. The 
Councl's field of activities is divided among thirteen divisions, gathered 
into two main groups; first, one of six "general relations'* divisions, 
and second, one of seven divisions devoted to special lines of science 
and technology. Each of these divisions has a resident chairman and 
a small office staff in Washington and a number of non-resident 
members. 

"There is a Division of Anthropology and Psychology, as yet with- 
out a chairman,* but with a list of members chosen from among the 
leading psychologists and anthropologists of the country." 



Dr. W. V. Bingham, Head of the Division of Applied Psychology 
of the Carnegie Institute of Technology at Pittsburgh, has been ap- 
pointed Chairman of the Division of Anthropology and Psychology 
of the National Research Council. Dr. Bingham is an authority on 
methods for measuring the intelligence of normal adults. Early in the 
war. as Secretary of the Committee on Classification of Personnel of 
the Army, Dr. Bingham applied these methods to testing the mental 
capacity and fitness of recruits as a basis for assignment and training 
for particular military duties, and later continued this work as Lieu- 
tenant-Colonel in the Personnel Branch of the General Staff. 

At present Dr. Bingham is connected with several bureaus of the 
Carnegie Institute, which are engaged in studying the application of 
these principles in commercial and industrial occupations. One of 
these bureaus, that of Personnnel Research, is supported by annual 
contributions from 30 corporations. This bureau is engaged in ascer- 
taining the best methods for selecting and developing executives, 
salesmen, and clerks. 

Another bureau is applying the same principles in developing meth- 
ods for selecting and thoroughly training workers in about 900 posi- 
tions in seven of the Icadnig department stores of Pittsburgh. These 
stores contribute $32,000 annually for these investigations. The finan- 
cial support given this work of investigating and applying scientific 
mental tests reveals the confidence which is being placed by corpora- 
tions and store executives in the money value of a rational study of 
their employment problems. 



An appropriation of fifty thousand dollars in five annual payments 
has been granted to the Iowa Child Welfare Research Station of the 
State University of Iowa, of which Dr. Bird T. Baldwin is director, by 
the National W'omen's Christian Temperance Union, for the purpose of 
making detailed scientific investigation into the development and con- 
servation of child life. The gift is for research and the station will 

♦ Since this statement was first published, such appointment has 
been made. See notice following. 
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lie given a wide range of freedom in the selection of its problems, 
"which will center around the field of eugenics, nutrition, and the 
mental and social development of the child. Dean Carl E. Seashore 
is chairman of the advisory committee. 



The Society for American Fellowships in French Universities offers 
each year for open competition among graduates of American colleges 
and other suitably qualified candidates a number of fellowships, not 
to exceed twenty-five, for the purpose of encouraging advanced study 
and research in French Universities. 

The fellowships, of the annual value of $1000, are granted for one 
year and are renewable for a second year. They may be awarded in 
the following fields of study: 

Anthropology, Archaeology and History of Art, Astronomy, Botany 
and Agriculture, Chemistry, Criminology, Education, Engineering, 
Geography, Geology, History, Law, Mathematics, Medicine, Philology: 
Qassical, Romance, Oriental, Semitic, English, — Philosophy, Physics, — 
Political Science: Economics and International Law,— Psychology, 
Religion, Sociology, Zoology. 

Fellows will be required to sail to France not later than July ist of 
the year in which the award. is made, to matriculate in a French Uni- 
versity for the following session, and to pursue studies in the field of 
science designated in their awards. They will be expected to send 
accounts of their studies together with reports of their progress from 
their instructors. 

Applicants, men or women, must be citizens of the United States and 
at least twenty years of age. They must be: 

1. Graduates of a college requiring four years of study for a degree, 
based on fourteen units of high school work; or, 

2. Graduates of a professional school requiring three years of study 
for a degree; or, 

3. H not qualified in either of these ways, must be twenty-four years 
of age and have spent five years in an industrial establishment in work 
requiring technical skill. 

Applicants must be of good moral character and intellectual ability, 
and must have a practical ability to use French books. 

Applications must be made on Application Blanks furnished by the 
Society and must be accompanied by : 

1. A Certificate of birth; 

2. A Certificate of Naturalization, if needed; 

3. A Certificate of College Studies; 

4. A Certificate of Industrial Work, if needed; 

5. Testimonials to Moral Character and Intellectual Ability ; 

6. A Photograph, signed and taken within a year; and 

7. Printed or written articles, theses and boioks, written or published 
by the applicant. 

Applications should reach the Secretary of the Society not later than 
January ist of the year in which the award is to be made. 

Application Blanks and further information about the fellowships 
may be obtained from the Secretary, 

Dr. I. L. Kandel, 

576 Fifth Avenue, New York. 
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The Massachus.etts Society for Mental Hygiene, of which Professor 
William H. Bumham of Clark University is die president, held a G>n- 
ference on Mental Hygiene in Worcester, Mass., November 14th, 1919. 
Dr. Walter S. Femald, Superintendent of the Massachusetts School 
for the Feeble-minded, outlined a state program for the care of these 
unfortunates which involves a statistical survey and official record of 
all feeble-minded in the state, supervision and care of those who are 
not inmates of institutions, with the help of social and charity organi- 
zations, provision for special training during the formative period, 
and the inauguration of local mental clinics. Dr. Bumham showed that 
success and failure in school were important conditions influencing 
mental health and pointed out that present day administration and 
methods presented too many opportunities for failure and did not 
sufficiently utilize the mental stimulus of success. Dr. E. £. Southard, 
Director of the Massachusetts State Psychiatric Institute in Boston, 
summarized and classified the most important causes of mental ills 
under the headings of disease, ignorance, vice, legal entanglements, 
and poverty, which most frequently operate in pairs but only rarely 
alone, and showed that successful attack upon one member of a pair 
usually results in a great diminution, if not entire disappearance, of 
the other member. Dr. A. W. Steams concluded the program by a 
brief summary of the aims and methods of the Society. 



It is a matter of common knowledge that the increased cost of pro- 
duction of to-day is in large measure due to the demand on the part 
of labor for shorter working hours and more pay. The common way 
of the manufacturer of meeting this increased cost has been to pass 
it all and a little more on to the consumer by greatly raising the price 
of his commodity. 

At the Athenaeum Press, where Ginn and Company's books are 
manufactured, there has just been inaugurated a plan of training fore- 
men, forewomen, and other factory supervisors in production methods. 
A three-months' course is being conducted by the Business Training 
Corporation of New Vork for a group of forty-six, composed of the 
treasurer, press manager, department heads, and all foremen from the 
man in charge of a room of fifty to the one who supervises the work 
of two or three. The work consists in the study of especially prepared 
subjects, the solution of problems relating to each subject, and the 
discussion of this material at six bi-weekly meetings. At each meeting 
a lecture is delivered by an experienced production man. Afterward 
the meeting is thrown open to discussion of the material set forth in 
the text, and problems which may be peculiar to any particular branch 
of work in the plant. The subjects covered are teamwork, handling 
men. machinery and materials, organization, production records and 
management. 

Beside a more thorough all-round knowledge of production meth- 
ods, the course gives an opportunity for the leaders in the Press to 
get together, discuss important problems, not only among themselves, 
but with the higher executives, and to acquire at first hand the spirit 
of unity and team play which in the last analysis means the elimina- 
tion of unrest. 
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